-- Logs begin at Thu 2022-05-19 13:07:18 UTC, end at Thu 2022-05-19 14:15:19 UTC. -- May 19 13:45:06.917746 dv-cinder-784815-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 13:45:06.927545 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 13:45:06 2022] *** May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: nodename: dv-cinder-784815-14-iscsi May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: machine: x86_64 May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: clock source: unix May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: pcre jit disabled May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: detected number of CPU cores: 4 May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: current working directory: / May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: detected binary path: /usr/bin/uwsgi-core May 19 13:45:06.929503 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: your processes number limit is 47680 May 19 13:45:06.930133 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: your memory page size is 4096 bytes May 19 13:45:06.930133 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: detected max file descriptor number: 2048 May 19 13:45:06.930133 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: lock engine: pthread robust mutexes May 19 13:45:06.930133 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: thunder lock: enabled May 19 13:45:06.930133 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 13:45:06.930133 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 13:45:06.974716 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: Python main interpreter initialized at 0x56345fe579c0 May 19 13:45:06.974716 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: python threads support enabled May 19 13:45:06.974716 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: your server socket listen backlog is limited to 100 connections May 19 13:45:06.974716 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: your mercy for graceful operations on workers is 90 seconds May 19 13:45:06.975110 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: mapped 403077 bytes (393 KB) for 2 cores May 19 13:45:06.975187 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: *** Operational MODE: preforking *** May 19 13:45:06.975397 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: *** uWSGI is running in multiple interpreter mode *** May 19 13:45:06.975397 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: spawned uWSGI master process (pid: 109322) May 19 13:45:06.975591 dv-cinder-784815-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 13:45:06.979251 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: spawned uWSGI worker 1 (pid: 109323, cores: 1) May 19 13:45:06.979251 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: spawned uWSGI worker 2 (pid: 109324, cores: 1) May 19 13:45:06.979251 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 13:45:08.173337 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 13:45:08.174559 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 13:45:08.906242 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:45:08.906242 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: from cryptography.utils import int_from_bytes May 19 13:45:08.906567 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:45:08.906567 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: from cryptography.utils import int_from_bytes May 19 13:45:08.906691 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:45:08.906691 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: from cryptography.utils import int_from_bytes May 19 13:45:08.907530 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:45:08.907530 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: from cryptography.utils import int_from_bytes May 19 13:45:11.541345 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 13:45:11.541977 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 13:45:11.542117 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 13:45:11.542479 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 13:45:11.542737 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 13:45:11.543150 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.543481 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.543802 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.544121 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.544450 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.544759 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.545080 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.545398 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.545753 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.546012 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.546331 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.546650 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784815-14-iscsi {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.547001 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.547311 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.547622 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.547946 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.548250 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.548569 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.548872 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.549368 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.549793 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.550103 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.550415 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.550516 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 13:45:11.550912 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 13:45:11.550987 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.551160 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.551472 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.551794 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.552110 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.552436 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.552744 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.553140 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784815-14-iscsi {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.553458 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.553772 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.554084 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.554495 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.554807 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.555147 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.555468 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.555792 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.556101 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.556427 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.556749 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.556874 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 13:45:11.557069 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.557200 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 13:45:11.557384 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.557475 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 13:45:11.557684 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.557856 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.557993 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.558200 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.558313 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.558531 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.558639 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.558855 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.558964 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.559213 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.559303 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.559460 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.559556 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.559767 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.559867 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.560086 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.560182 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.560405 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.560494 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.560725 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.560811 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.560973 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.561061 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.561746 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.561845 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784815-14-iscsi {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.562064 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.562163 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.562388 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.562485 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.562698 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.562799 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.563033 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.563143 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.563341 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.563431 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.563648 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.563808 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.563952 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.564177 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.564371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.564683 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.564771 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.564990 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.565096 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.565306 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.565395 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.565622 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.565711 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.565946 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.566048 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.566256 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.566344 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.566576 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.566664 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.567049 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.567240 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.567339 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.567427 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.567602 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.567700 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.567944 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.568047 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.568264 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.568407 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784815-14-iscsi {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.568571 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.568735 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.568888 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.569058 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.569211 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.569381 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.569521 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.569806 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.569908 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.570123 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.570217 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.570436 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.570535 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.570756 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.570844 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.571086 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.571185 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.571339 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.571437 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.571640 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.571739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.571947 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.572040 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.572266 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.572363 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.572577 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.572674 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.572883 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.572978 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.573186 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.573276 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.573487 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.573577 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.573792 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.573889 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.574098 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.574195 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.574404 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.574492 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.574689 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.574792 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.575024 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.575114 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.575329 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.575419 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.575635 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.575731 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.575939 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.576028 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.576242 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.576330 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.576507 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.576602 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.577432 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.577660 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.577752 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.577840 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.578022 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.578131 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.578328 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.578434 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.578635 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.578738 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.578987 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.579097 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.579295 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.579389 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.579598 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.579692 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.579918 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.580006 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.580222 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.580309 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.580527 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.580619 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.580842 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.580931 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.581147 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.581239 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.581451 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.581537 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.581769 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.581880 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.582070 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.582176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.582378 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.582465 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.582694 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.582790 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.583023 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.583123 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.583329 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.583422 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.583633 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.583720 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.583936 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.584029 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.584238 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.584332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.584540 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.584625 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.584840 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.584938 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.585141 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.585240 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.585438 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.585525 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.585752 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.585838 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.586071 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.586166 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.586344 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.586435 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.586650 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.586762 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.586981 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.587091 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.587300 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.587395 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.587609 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.587695 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.587921 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.588023 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.588232 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.588327 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.588539 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.588626 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.588849 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.588944 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.589159 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.589253 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.589468 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.589566 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.589778 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.589866 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.590089 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.590176 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.590394 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.590481 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.590702 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.590790 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.591033 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.591163 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.591341 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.591481 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.591659 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.591793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.591979 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.592133 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.592289 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.592497 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.592632 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.592767 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.592985 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.593111 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.593307 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.593445 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.593618 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.593744 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.593942 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.594066 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.594247 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.594455 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.594583 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.594706 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.594891 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.595022 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.595196 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.595332 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.595517 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.595646 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.595828 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.595955 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.596138 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.596273 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.596460 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.596588 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.596763 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.596894 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.597073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.597201 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.597393 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.597521 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.597704 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.597840 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.598010 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.598146 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.598318 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.598445 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.598626 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.598753 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.598956 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.599097 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.599265 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.599399 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.599571 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.599714 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.599877 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.600006 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.600179 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.600312 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.600499 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.600626 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.600822 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.600948 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.601133 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.601258 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.601442 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.601567 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.601748 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.601876 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.602058 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.602184 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:45:11.602374 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.602501 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.602684 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.602824 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.603013 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.603143 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.603318 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.603454 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.603621 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.603756 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.603930 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.604065 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.604233 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.604370 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.604553 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.604680 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.604880 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.605018 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.605187 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.605324 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.605515 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.605643 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.605819 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.605946 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.606128 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.606263 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.606436 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.606563 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.606744 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.606903 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.607075 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.607203 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.607387 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.607515 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.607694 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.607813 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.608018 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.608154 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.608345 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.608487 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.608716 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.608844 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.609050 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.609180 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.609380 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.609508 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.609696 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.609832 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.610018 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.610152 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.610332 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.610467 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.610643 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.610780 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.610980 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.611108 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.611295 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.611424 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.611604 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.611746 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.611926 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.612063 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.612238 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.612357 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.612549 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.612684 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.612884 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.613011 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.613198 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.613331 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.613505 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.613631 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.613826 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.613952 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.614141 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.614270 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.614455 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.614590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.614757 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.614955 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.615083 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.615206 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.615387 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.615515 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.615691 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.615819 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.615995 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.616123 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.616303 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.616441 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.616605 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.616739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.616908 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.617108 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.617235 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.617358 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.617502 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.617642 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.617803 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.617931 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.618121 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.618253 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.618426 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.618558 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.618729 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.618888 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.619058 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.619184 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.619362 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.619488 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.619697 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.619832 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.620000 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.620126 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.620333 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.620466 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.620644 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.620774 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.620954 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.621081 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.621268 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.621403 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.621579 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.621709 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.621886 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.622014 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.622200 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.622325 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.622510 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.622636 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.622815 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.623004 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.623152 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.623278 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.624231 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.624516 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.624768 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.624909 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.625034 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.625158 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.625291 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.625440 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.625575 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.625758 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.625886 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.626072 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.626225 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.626384 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.626510 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.626690 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.626816 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.627025 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.627155 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.627352 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.627481 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.627669 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.627798 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.627985 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.628113 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.628307 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.628439 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.628619 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.628747 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.628935 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.629065 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.629244 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.629371 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.629558 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.629693 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.629868 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.629995 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.630173 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.630299 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.630487 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.630624 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.630795 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.630955 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.631128 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.631267 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.631436 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.631578 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.631746 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.631872 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.632053 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.632184 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.632360 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.632495 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.632660 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.632785 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.632963 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.633089 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.633269 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.633398 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.633595 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.633722 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.633908 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.634040 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.634214 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.634341 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.634522 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.634649 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.634829 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.634977 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.635163 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.635292 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.635473 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.635600 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.635779 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.635908 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.636083 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.636211 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.636390 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.636517 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.636703 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.636838 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.637013 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.637148 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.637322 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.637449 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.637623 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.637758 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.637935 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.638070 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.638242 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.638368 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.638544 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.638680 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.638845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.638993 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.639176 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.640099 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.640228 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.640366 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.640493 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.640617 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.640749 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.640874 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.640997 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.641129 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.641253 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.641384 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.641508 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.641662 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.641832 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.641984 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.642139 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.642329 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.642457 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.642667 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.642804 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.643015 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.643144 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.643344 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.643472 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.643666 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.643808 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.643970 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.644107 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.644284 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.644419 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.644599 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.644735 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.644905 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.645031 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.645217 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.645342 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.645525 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.645652 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.645836 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.645971 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.646154 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.646280 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.646465 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.646602 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.646773 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.646923 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.647114 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.647249 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.647448 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.647574 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.647723 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.647858 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.648034 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.648160 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.648353 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.648481 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.648662 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.648833 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.648967 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.649100 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.649267 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.649403 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.649570 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.649698 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.649880 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.650021 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.650196 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.650322 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.650511 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.650761 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.650951 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.651123 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.651249 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.651423 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.651559 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.651743 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.651869 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.652059 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.652194 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.652372 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.652499 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.652680 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.652809 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.652997 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.653124 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.653308 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.653435 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.653616 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.653751 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.653925 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.654061 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.654228 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.654354 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.654533 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.654659 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.654886 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.655041 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.655250 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.655515 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.655644 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.655766 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.655902 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.656027 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.656163 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.656287 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.656433 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.656560 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.656737 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.656865 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.657041 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.657176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.657346 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.657475 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.657659 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.657795 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.657960 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.658096 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.658299 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.658433 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.658559 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.658683 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.658897 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.659023 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.659209 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.659328 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.659512 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.659621 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.659814 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.659916 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.660117 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.660428 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.660533 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.660750 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.660847 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.661063 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.661169 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.661376 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.661481 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.661691 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.661788 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.662005 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.662102 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.662304 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.662410 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.662619 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.662716 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.662967 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.663065 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.663273 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.663362 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.663580 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.663720 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.663887 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.664017 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.664193 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.664319 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.664491 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.664626 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.664799 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.664936 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.665193 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.665380 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.665513 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.665696 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.665826 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.666016 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.666143 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.666338 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.666461 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.666661 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.666791 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.667004 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.667147 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.667314 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.667442 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.667615 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.667737 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.667915 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.668042 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.668221 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.668362 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.668527 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.668663 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.668828 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.668957 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.669136 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.669263 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.669438 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.669579 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.669750 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.669889 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.670056 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.670183 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.670356 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.670712 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.670909 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.671038 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.671038 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.671271 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.671472 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.671599 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.671722 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.671846 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.671976 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.672102 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.672235 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.672359 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.672482 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.672613 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.672783 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.672911 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.673087 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.673217 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.673390 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.673517 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.673695 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.673831 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.674001 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.674137 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.674304 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.674431 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.674612 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.674748 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.674962 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.675099 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.675227 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.675350 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.675529 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.675670 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.675835 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.675962 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.676139 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.676268 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.676447 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.676584 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.676750 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.676878 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.677052 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.677179 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.677353 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.677482 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.677654 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.677781 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.677955 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.678084 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.678276 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.678406 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.678583 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.678710 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.678908 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.679037 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.679215 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.679350 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.679516 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.679643 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.679825 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.679950 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.680138 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.680266 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.680443 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.680572 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.680752 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.680887 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.681059 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.681187 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.681374 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.681510 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.681684 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.681818 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.681985 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.682112 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.682288 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.682416 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.682595 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.682733 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.682906 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.683043 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.683216 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.683351 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.683528 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.683665 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.683839 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.683967 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.684155 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.684283 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.684462 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.684597 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.684769 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.684896 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.685072 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.685208 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.685385 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.685514 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.685696 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.685825 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.686002 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.686639 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.686841 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.687001 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.687178 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.687306 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.687482 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.687608 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.687788 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.687916 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.688098 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.688222 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.688398 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.688531 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.688705 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.688842 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.689016 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.689142 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.689331 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.689466 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.689643 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.689770 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.689946 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.690073 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.690254 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.690389 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.690560 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.690685 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.690900 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.691046 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.691196 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.691336 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.691506 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.691641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.691811 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.691938 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.692113 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.692240 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.692415 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.692541 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.692720 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.692844 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.693022 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.693152 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.693329 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.693453 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.693638 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.693770 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.693953 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.694097 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.694250 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.694378 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.694557 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.694684 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.694932 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.695074 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.695241 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.695369 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.695569 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.695702 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.695883 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.696009 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.696187 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.696321 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.696508 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.696646 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.696823 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.696951 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.697136 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.697264 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.697455 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.697591 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.697763 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.697890 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.698073 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.698198 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.698384 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.698520 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.698700 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.698825 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.699028 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.699164 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.699333 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.699469 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.699637 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.699772 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.699958 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.700083 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.700281 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.700408 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.700568 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.700695 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.700902 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.701026 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.701232 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.701360 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.701543 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.701669 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.702513 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.702643 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.702831 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.703089 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.703244 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.703569 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.703695 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.703892 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.704176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.704304 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.704509 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.704724 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.704859 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.705124 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.705274 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.705449 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.705772 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.705897 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.706083 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.706360 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.706489 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.706694 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.706932 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.707063 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.707362 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.707500 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.707678 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.707999 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.708123 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.708412 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.708541 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.708734 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.709046 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.709174 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.709367 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.709591 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.709732 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.709987 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.710164 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.710290 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.710590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.710717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.710919 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.711232 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.711370 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.711557 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.711803 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.711931 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.712164 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.712341 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.712469 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.712769 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.712895 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.713082 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.713387 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.713518 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.713709 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.714013 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.714130 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.714335 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.714647 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.714846 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.715034 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.715230 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.715357 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.715598 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.715774 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.715910 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.716215 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.716341 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.716520 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.716823 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.716948 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.717125 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.717924 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.718086 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.718940 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.719076 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.719202 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.719343 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.719470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.719593 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.719717 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.719841 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.719969 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.720102 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.720228 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.720354 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.720478 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.720602 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.720739 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.720864 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.721029 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.721165 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.721356 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.721486 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.721662 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.721799 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.721967 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.722096 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.722279 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.722408 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.722586 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.722716 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.722920 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.723052 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.723225 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.723361 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.723534 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.723703 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.723831 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.724023 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.724151 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.724342 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.724473 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.724723 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.724850 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.725026 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.725154 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.725347 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.725477 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.725655 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.725791 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.725959 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.726087 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.726263 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.726393 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.726567 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.726696 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.726931 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.727061 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.727238 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.727375 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.727573 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.727699 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.727887 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.728026 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.728206 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.728333 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.728525 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.728652 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.728834 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.728973 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.729158 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.729286 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.729476 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.729611 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.729792 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.729927 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.730106 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.730231 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.730419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.730554 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.730735 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.730901 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.731077 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.731221 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.731393 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.731521 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.731702 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.731839 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.732017 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.732144 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.732331 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.732458 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.732646 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.732774 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.733030 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.733729 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.733998 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.734129 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.734338 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.734474 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.734652 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.734780 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.734991 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.735132 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.735310 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.735436 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.735622 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.735748 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.735932 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.736076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.736243 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.736372 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.736551 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.736678 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.736863 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.737004 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.737190 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.737315 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.737509 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.737646 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.737832 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.737971 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.738157 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.738283 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.738466 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.738601 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.738779 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.738924 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.739119 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.739253 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.739430 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.739565 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.739740 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.739869 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.740051 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.740187 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.740379 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.740517 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.740693 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.740819 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.741004 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.741131 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.741318 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.741454 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.741629 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.741757 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.741941 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.742080 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.742254 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.742393 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.742567 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.742698 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.742915 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.743046 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.743214 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.743356 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.743527 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.743656 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.743839 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.743967 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.744146 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.744286 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.744467 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.744595 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.744777 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.744905 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.745104 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.745231 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.745379 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.745508 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.745690 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.745824 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.745994 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.746208 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.746347 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.746528 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.746656 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.746897 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.747041 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.747217 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.747346 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.747538 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.747665 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.747853 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.747989 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.748163 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.748291 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.748761 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.748929 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.749065 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.749219 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.749434 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.749572 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.749741 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.749871 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.750079 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.750208 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.750398 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.750535 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.750723 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.750881 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.751063 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.751223 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.751373 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.751501 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.751696 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.751838 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.752007 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.752135 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.752325 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.752535 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.752662 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.752889 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.753020 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.753206 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.753334 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.753532 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.753660 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.753857 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.753998 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.754168 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.754295 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.754473 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.754609 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.754796 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.754975 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.755131 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.755259 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.755437 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.755651 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.755781 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.755982 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.756111 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.756299 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.756427 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.756617 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.756755 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.756926 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.757053 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.757236 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.757363 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.757541 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.757677 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.757850 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.757978 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.758154 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.758291 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.758460 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.758590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.758772 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.758926 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.759111 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.759248 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.759417 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.759555 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.759727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.759855 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.760031 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.760169 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.760335 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.760463 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.760640 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.760769 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.760943 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.761078 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.761252 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.761380 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.761554 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.761695 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.761862 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.761991 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.762165 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.762294 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.762475 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.762610 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.762778 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.762925 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.763114 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.763243 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.763460 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.763596 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.763774 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.763909 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.764077 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.764222 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.764452 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.764588 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.764769 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.764951 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.765183 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.765315 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.765508 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.765646 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.765829 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.765957 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.766158 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.766287 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.766498 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.766647 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.766823 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.766982 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.767164 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.767460 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.767606 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.767791 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.767925 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.768110 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.768312 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.768439 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.768629 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.768758 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.768963 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.769098 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.769291 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.769420 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.769619 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.769747 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.769938 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.770066 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.770247 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.770389 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.770560 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.770689 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.770882 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.771023 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.771199 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.771334 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.771507 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.771641 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.771817 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.771946 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.772124 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.772260 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.772433 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.772559 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.772742 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.772878 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.773050 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.773185 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.773355 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.773481 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.773665 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.773793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.773978 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.774199 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.774329 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.774557 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.774685 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.774901 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.775108 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.775243 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.775369 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.775559 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.775687 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.775869 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.776005 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.776180 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.776316 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.776487 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.776616 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.776796 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.776926 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.777103 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.777236 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.777425 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.777560 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.777741 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.777868 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.778047 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.778175 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.778355 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.778482 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.778672 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.778801 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.779012 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.779141 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.779323 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.779452 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.779639 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.779769 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.780503 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.780641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.780837 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.780978 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.781149 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.781275 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.781456 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.781590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.781766 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.781907 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.782084 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.782212 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.782392 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.782521 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.782700 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.782842 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.783033 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.783162 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.783344 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.783472 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.783654 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.783782 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.783958 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.784086 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.784266 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.784395 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.784572 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.784706 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.784877 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.785003 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.785179 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.785309 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.785481 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.785610 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.785789 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.785925 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.786094 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.786229 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.786398 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.786526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.786700 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.786829 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.787028 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.787170 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.787336 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.787465 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.787636 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.787772 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.787937 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.788073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.788237 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.788366 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.788538 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.788666 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.788837 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.788973 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.789137 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.789431 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.789560 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.789730 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.789855 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.790032 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.790160 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.790332 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.790461 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.790632 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.790769 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.790955 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.791084 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.791286 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.791425 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.791616 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.791754 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.791929 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.792056 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.792249 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.792377 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.792561 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.792698 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.792871 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.792998 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.793178 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.793304 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.793489 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.793624 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.793802 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.793988 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.794116 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.794239 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.794407 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.794536 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.794718 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.794845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.795058 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.795195 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.795371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.796130 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.796270 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.796396 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.796521 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.796628 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.796806 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.796945 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.797114 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.797242 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.797439 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.797582 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.797766 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.797896 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.798069 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.798198 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.798392 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.798529 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.798702 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.798829 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.799046 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.799362 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.799682 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.800028 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.800345 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.800657 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.801079 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.801398 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.801722 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.802048 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.802361 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.802686 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.803066 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.803239 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.803385 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.803604 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.803732 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.803950 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.804077 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.804308 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.804444 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.804646 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.804774 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.804975 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.805099 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.805299 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.805427 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.805609 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.805736 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.805916 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.806044 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.806224 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.806363 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.806537 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.806665 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.806855 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.806996 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.807204 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.807333 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.807486 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.807623 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.807792 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.807920 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.808105 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.808233 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.808415 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.808542 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.808723 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.808860 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.809029 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.809156 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.809336 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.809489 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.809645 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.809810 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.809945 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.810129 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.810256 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.810440 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.810568 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.810701 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109324) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 13:45:11.810834 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.811183 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.811487 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.811800 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.812107 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.812415 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.812722 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.813028 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.813331 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.813666 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.814004 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.814327 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.814652 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.814997 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.815323 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.815635 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.815960 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.816285 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.816604 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.816919 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.817255 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.817578 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.817895 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.818212 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.818527 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.818840 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.819179 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.819512 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.819844 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.820157 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.820488 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.820811 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.821137 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.821457 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.821771 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.822103 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.822417 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.822731 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.823075 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.823392 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.823708 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.824032 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.824351 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.824679 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.825008 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.825321 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.825649 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.825978 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.826327 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.826643 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.827137 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.827481 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.827803 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.828122 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.828434 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:45:11.828680 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109323) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 13:45:11.870105 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO dbcounter [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Registered counter for database nova_api May 19 13:45:11.888515 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO dbcounter [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Registered counter for database nova_api May 19 13:45:11.891913 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG oslo_db.sqlalchemy.engines [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:45:11.898325 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writer thread running {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:45:11.908986 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_db.sqlalchemy.engines [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:45:11.915356 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writer thread running {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:45:11.955003 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.context [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15aabb13-0547-4fea-a3a2-4403ba090ba7(cell1) {{(pid=109324) load_cells /opt/stack/nova/nova/context.py:464}} May 19 13:45:11.960479 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG oslo_concurrency.lockutils [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:11.962027 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG oslo_concurrency.lockutils [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:11.962819 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG oslo_concurrency.lockutils [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:11.964768 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG oslo_concurrency.lockutils [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109324) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:11.966727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO dbcounter [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Registered counter for database nova_cell0 May 19 13:45:11.971763 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO dbcounter [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Registered counter for database nova_cell1 May 19 13:45:11.973243 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.context [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15aabb13-0547-4fea-a3a2-4403ba090ba7(cell1) {{(pid=109323) load_cells /opt/stack/nova/nova/context.py:464}} May 19 13:45:11.978795 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG oslo_db.sqlalchemy.engines [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:45:11.978986 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:11.980423 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:11.980979 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG oslo_db.sqlalchemy.engines [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:45:11.981228 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:45:11.983861 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:45:11.985810 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO dbcounter [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Registered counter for database nova_cell0 May 19 13:45:11.986758 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writer thread running {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:45:11.989197 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writer thread running {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:45:11.989945 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO dbcounter [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Registered counter for database nova_cell1 May 19 13:45:11.997253 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_db.sqlalchemy.engines [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:45:12.001952 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_db.sqlalchemy.engines [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:45:12.003463 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writer thread running {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:45:12.132467 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO dbcounter [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Registered counter for database nova_cell0 May 19 13:45:12.141148 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG oslo_db.sqlalchemy.engines [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109324) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:45:12.143018 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writer thread running {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:45:12.145469 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writer thread running {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:45:12.151914 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO dbcounter [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Registered counter for database nova_cell0 May 19 13:45:12.158810 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_db.sqlalchemy.engines [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109323) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:45:12.163302 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writer thread running {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:45:12.482479 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: WARNING keystonemiddleware.auth_token [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:45:12.483046 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: WARNING keystonemiddleware.auth_token [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:45:12.489901 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: WARNING keystonemiddleware.auth_token [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:45:12.490444 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: WARNING keystonemiddleware.auth_token [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:45:12.834911 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: WARNING keystonemiddleware.auth_token [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:45:12.837779 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: WARNING keystonemiddleware.auth_token [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:45:12.840906 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: WARNING keystonemiddleware.auth_token [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:45:12.844252 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: WARNING keystonemiddleware.auth_token [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:45:12.846166 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56345fe579c0 pid: 109324 (default app) May 19 13:45:12.848233 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:45:12.849354 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56345fe579c0 pid: 109323 (default app) May 19 13:45:12.849448 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-6d293a0f-89db-461a-981a-72576f3e8af3 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 May 19 13:45:12.849800 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Thu May 19 13:45:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:31.218333 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:31.219581 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001982 May 19 13:46:31.220133 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:46:31.235539 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writing DB stats nova_api:SELECT=3 {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:46:31.236633 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writing DB stats nova_cell0:SELECT=3 {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:46:31.237464 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writing DB stats nova_cell1:SELECT=3 {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:46:31.238384 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:46:31.695530 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-c764232a-4192-49d5-ab37-9b6e1214c836 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:31.727124 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-c764232a-4192-49d5-ab37-9b6e1214c836 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.501063 May 19 13:46:31.727859 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 2/3] 10.222.0.52 () {60 vars in 1291 bytes} [Thu May 19 13:46:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:46:34.035382 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:34.036381 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-ac58535a-80fb-4e21-8055-d1c253765ffc None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 19 13:46:34.036782 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 2/4] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:34.099705 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-f8666d05-84af-4ef2-858e-229f593e2c48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:34.117908 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:46:34.117908 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: warnings.warn(msg) May 19 13:46:34.151514 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-f8666d05-84af-4ef2-858e-229f593e2c48 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108545 May 19 13:46:34.154924 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 3/5] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:46:34.388574 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-418836d7-9640-4b7c-a66c-6dc819dee226 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:34.388574 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:46:34.388574 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: warnings.warn(msg) May 19 13:46:34.391203 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_api:SELECT=3 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:46:34.392172 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_cell0:SELECT=3 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:46:34.392958 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_cell1:SELECT=3 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:46:34.394115 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_cell0:SELECT=3 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:46:34.460286 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-418836d7-9640-4b7c-a66c-6dc819dee226 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.299545 May 19 13:46:34.461119 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 3/6] 10.222.0.52 () {64 vars in 1335 bytes} [Thu May 19 13:46:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:46:36.740406 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-f8666d05-84af-4ef2-858e-229f593e2c48 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:36.742032 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-f8666d05-84af-4ef2-858e-229f593e2c48 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 May 19 13:46:36.742899 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 4/7] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:36.870376 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-bca3519d-0a09-4820-b25e-084ca86b746f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:36.889021 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:46:36.889021 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: warnings.warn(msg) May 19 13:46:36.907150 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-bca3519d-0a09-4820-b25e-084ca86b746f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155888 May 19 13:46:36.907715 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 4/8] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:46:36.920013 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-9761699d-b29d-4e68-b49e-8cbc4a56126b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:36.921588 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:46:36.921588 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: warnings.warn(msg) May 19 13:46:36.953599 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-9761699d-b29d-4e68-b49e-8cbc4a56126b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037902 May 19 13:46:36.954284 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 5/9] 10.222.0.52 () {64 vars in 1335 bytes} [Thu May 19 13:46:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:46:39.221738 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-bca3519d-0a09-4820-b25e-084ca86b746f admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:39.223000 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-bca3519d-0a09-4820-b25e-084ca86b746f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 May 19 13:46:39.223659 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:39.286692 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-307cf1d9-7659-4d56-8cfa-0f5bb3c14c68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:39.306651 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-307cf1d9-7659-4d56-8cfa-0f5bb3c14c68 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077133 May 19 13:46:39.307500 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 6/11] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:46:39.319687 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-6549bcd6-4d05-42b8-bc36-2f7f702f847f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:39.347412 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-6549bcd6-4d05-42b8-bc36-2f7f702f847f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031358 May 19 13:46:39.348614 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 6/12] 10.222.0.52 () {64 vars in 1335 bytes} [Thu May 19 13:46:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:46:41.623807 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-307cf1d9-7659-4d56-8cfa-0f5bb3c14c68 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:41.625073 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-307cf1d9-7659-4d56-8cfa-0f5bb3c14c68 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 May 19 13:46:41.625471 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 7/13] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:41.686571 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-6bee1762-10cf-4dd9-b4fe-d62f36ee5291 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "disk": 10, "ram": 2048}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:41.707277 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-6bee1762-10cf-4dd9-b4fe-d62f36ee5291 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076193 May 19 13:46:41.707844 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 7/14] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:46:41.724082 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-d8415483-29b7-4197-bb3f-e3b51915a583 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:41.750156 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-d8415483-29b7-4197-bb3f-e3b51915a583 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030350 May 19 13:46:41.751136 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 8/15] 10.222.0.52 () {64 vars in 1335 bytes} [Thu May 19 13:46:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:46:44.068207 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-6bee1762-10cf-4dd9-b4fe-d62f36ee5291 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:44.069299 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-6bee1762-10cf-4dd9-b4fe-d62f36ee5291 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 May 19 13:46:44.069713 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 8/16] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:44.135916 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-ff510bbc-3445-40f1-ae4e-df02dd5ae29d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:44.156681 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-ff510bbc-3445-40f1-ae4e-df02dd5ae29d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080535 May 19 13:46:44.157234 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 9/17] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:46:44.170039 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-58f8a719-86b3-4115-8e56-4a29e86eca17 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:44.193863 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-58f8a719-86b3-4115-8e56-4a29e86eca17 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028533 May 19 13:46:44.194447 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 9/18] 10.222.0.52 () {64 vars in 1335 bytes} [Thu May 19 13:46:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:46:46.472308 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-ff510bbc-3445-40f1-ae4e-df02dd5ae29d admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:46.473456 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-ff510bbc-3445-40f1-ae4e-df02dd5ae29d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 May 19 13:46:46.474395 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 10/19] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:46.536744 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-c563c855-913e-449f-adf0-46daee36bc48 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:46.559929 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-c563c855-913e-449f-adf0-46daee36bc48 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079887 May 19 13:46:46.560564 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 10/20] 10.222.0.52 () {60 vars in 1291 bytes} [Thu May 19 13:46:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:46:48.828364 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-ff510bbc-3445-40f1-ae4e-df02dd5ae29d admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:48.829409 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-ff510bbc-3445-40f1-ae4e-df02dd5ae29d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 May 19 13:46:48.829985 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 11/21] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:48.891096 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-d27b078a-52c5-408b-8570-852dd5aaf3c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "swap": 0, "vcpus": 1}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:48.908975 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-d27b078a-52c5-408b-8570-852dd5aaf3c7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073083 May 19 13:46:48.909521 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 11/22] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:46:48.922341 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-4799f23f-85e6-4c55-ae2c-c178bbe97158 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:48.946172 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-4799f23f-85e6-4c55-ae2c-c178bbe97158 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028451 May 19 13:46:48.946690 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 12/23] 10.222.0.52 () {64 vars in 1332 bytes} [Thu May 19 13:46:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:46:51.235915 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-d27b078a-52c5-408b-8570-852dd5aaf3c7 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:51.236927 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-d27b078a-52c5-408b-8570-852dd5aaf3c7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 19 13:46:51.237325 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:51.300999 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-22aff8ed-15c7-4d04-9930-727462675713 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "vcpus": 1, "id": "2", "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:51.319939 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-22aff8ed-15c7-4d04-9930-727462675713 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076741 May 19 13:46:51.320495 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 13/25] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:46:51.333404 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-d3983320-ecff-4d96-8614-cd1bc476e5e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:51.359160 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-d3983320-ecff-4d96-8614-cd1bc476e5e0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029894 May 19 13:46:51.359733 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 13/26] 10.222.0.52 () {64 vars in 1332 bytes} [Thu May 19 13:46:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:46:53.645620 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-22aff8ed-15c7-4d04-9930-727462675713 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:53.646658 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-22aff8ed-15c7-4d04-9930-727462675713 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001720 May 19 13:46:53.647210 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:53.720890 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-ef6b0f5a-b45c-4400-9825-eaa7463d529c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:53.742431 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-ef6b0f5a-b45c-4400-9825-eaa7463d529c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.088118 May 19 13:46:53.743173 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 14/28] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:46:53.756232 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-8ef3ba26-a689-47e7-8b1e-d6c99bc5835f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:53.784986 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-8ef3ba26-a689-47e7-8b1e-d6c99bc5835f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033016 May 19 13:46:53.786053 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 15/29] 10.222.0.52 () {64 vars in 1332 bytes} [Thu May 19 13:46:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:46:56.083012 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-ef6b0f5a-b45c-4400-9825-eaa7463d529c admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:56.084062 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-ef6b0f5a-b45c-4400-9825-eaa7463d529c admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 May 19 13:46:56.084471 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 15/30] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:56.143174 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-da1296a4-49c2-413c-a5af-a88707f218d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "ram": 8192}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:56.168154 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-da1296a4-49c2-413c-a5af-a88707f218d7 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077625 May 19 13:46:56.169582 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 16/31] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 13:46:56.181837 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-3f6631e8-d60b-431b-b9a5-469c976aafb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:56.205297 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-3f6631e8-d60b-431b-b9a5-469c976aafb8 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027367 May 19 13:46:56.205866 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 16/32] 10.222.0.52 () {64 vars in 1332 bytes} [Thu May 19 13:46:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:46:58.488679 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-da1296a4-49c2-413c-a5af-a88707f218d7 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:46:58.490327 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-da1296a4-49c2-413c-a5af-a88707f218d7 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 May 19 13:46:58.490937 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 17/33] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:46:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:46:58.559411 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-9935f391-944e-41f2-a8d0-4cac9944159f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160, "ram": 16384, "id": "5", "rxtx_factor": 1.0}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:58.579794 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-9935f391-944e-41f2-a8d0-4cac9944159f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082572 May 19 13:46:58.582481 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 17/34] 10.222.0.52 () {64 vars in 1282 bytes} [Thu May 19 13:46:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:46:58.595274 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-9fe93b06-4815-4f9e-9259-0da355c16c52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:46:58.618482 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-9fe93b06-4815-4f9e-9259-0da355c16c52 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027294 May 19 13:46:58.623471 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 18/35] 10.222.0.52 () {64 vars in 1332 bytes} [Thu May 19 13:46:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:47:25.521071 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-9935f391-944e-41f2-a8d0-4cac9944159f admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:25.522077 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-9935f391-944e-41f2-a8d0-4cac9944159f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 19 13:47:25.522468 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 18/36] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:47:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:47:25.533606 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:47:25.581987 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-19507393-fbe5-45fa-bfb2-b8f74ca95191 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:25.599087 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-19507393-fbe5-45fa-bfb2-b8f74ca95191 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070026 May 19 13:47:25.599612 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 19/37] 10.222.0.52 () {60 vars in 1291 bytes} [Thu May 19 13:47:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:47:26.612305 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-9935f391-944e-41f2-a8d0-4cac9944159f admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:26.613337 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-9935f391-944e-41f2-a8d0-4cac9944159f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 19 13:47:26.613735 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 19/38] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:47:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:47:26.859256 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-3219b71c-e23f-4f8e-ba6f-55223cd8f409 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:26.864778 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.wsgi [None req-3219b71c-e23f-4f8e-ba6f-55223cd8f409 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-3219b71c-e23f-4f8e-ba6f-55223cd8f409 admin admin] Request method failure captured: May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Accept: application/json May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Accept-Encoding: gzip, deflate May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Connection: keep-alive May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Content-Length: 0 May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Host: 10.222.0.52 May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Openstack-Api-Version: compute 2.90 May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Openstack-System-Scope: None May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: User-Agent: python-novaclient May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Auth-Token: gAAAAABihkpucwH9eVkKRsaorulI57UwRTAjhy9lUx1JGY9avXUQw8beccD-AOa5JG4M4aXB87_bPXQIDBwjo8XIxlgK8f5A2mrOwVpjssXc2GIc9m9DN18CixCGx4uMZ55puTx7jqB9betXA_cfoL6mxMTyciofBa9sHyKrHVVj0MWf92Q0WZA May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Domain-Id: None May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Domain-Name: None May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Identity-Status: Confirmed May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Is-Admin-Project: True May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Domain-Id: default May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Domain-Name: Default May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Name: admin May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Role: member,admin,reader May 19 13:47:26.868009 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Roles: member,admin,reader May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}] May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Tenant: admin May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Tenant-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Tenant-Name: admin May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User: admin May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Domain-Id: default May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Domain-Name: Default May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Id: ea5484f975734ad68c3decb7b2d0c713 May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Name: admin May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: method: > May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: exception: Flavor 42 could not be found. May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: action_args: {'id': '42'} May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:47:26.869708 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:26.871371 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:26.872845 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-3219b71c-e23f-4f8e-ba6f-55223cd8f409 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:47:26.874111 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-3219b71c-e23f-4f8e-ba6f-55223cd8f409 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061271 May 19 13:47:26.874111 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1190 bytes} [Thu May 19 13:47:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:47:26.879740 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-ae55d218-d13d-4e0b-96a8-8c69e5a23ec8 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:26.882581 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:47:26.902162 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-ae55d218-d13d-4e0b-96a8-8c69e5a23ec8 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025833 May 19 13:47:26.902985 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 20/40] 10.222.0.52 () {60 vars in 1210 bytes} [Thu May 19 13:47:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:47:26.912680 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-d5ac1264-2fd4-44b8-b18b-185ff164ffb1 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:26.935105 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-d5ac1264-2fd4-44b8-b18b-185ff164ffb1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025943 May 19 13:47:26.935660 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 21/41] 10.222.0.52 () {60 vars in 1210 bytes} [Thu May 19 13:47:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:47:26.944942 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-d276eb70-a0b7-42bf-8f0e-fca1f687ff26 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:26.951537 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.wsgi [None req-d276eb70-a0b7-42bf-8f0e-fca1f687ff26 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-d276eb70-a0b7-42bf-8f0e-fca1f687ff26 admin admin] Request method failure captured: May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Accept: application/json May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Accept-Encoding: gzip, deflate May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Connection: keep-alive May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Content-Length: 0 May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Host: 10.222.0.52 May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Openstack-Api-Version: compute 2.90 May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Openstack-System-Scope: None May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: User-Agent: python-novaclient May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Auth-Token: gAAAAABihkpucwH9eVkKRsaorulI57UwRTAjhy9lUx1JGY9avXUQw8beccD-AOa5JG4M4aXB87_bPXQIDBwjo8XIxlgK8f5A2mrOwVpjssXc2GIc9m9DN18CixCGx4uMZ55puTx7jqB9betXA_cfoL6mxMTyciofBa9sHyKrHVVj0MWf92Q0WZA May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Domain-Id: None May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Domain-Name: None May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Identity-Status: Confirmed May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Is-Admin-Project: True May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Domain-Id: default May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Domain-Name: Default May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Name: admin May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Role: member,admin,reader May 19 13:47:26.954793 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Roles: member,admin,reader May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}] May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Tenant: admin May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Tenant-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Tenant-Name: admin May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User: admin May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Domain-Id: default May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Domain-Name: Default May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Id: ea5484f975734ad68c3decb7b2d0c713 May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Name: admin May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: method: > May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: exception: Flavor 42 could not be found. May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: action_args: {'id': '42'} May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:47:26.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:26.957298 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:26.958526 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-d276eb70-a0b7-42bf-8f0e-fca1f687ff26 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:47:26.959759 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-d276eb70-a0b7-42bf-8f0e-fca1f687ff26 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014865 May 19 13:47:26.959759 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 21/42] 10.222.0.52 () {60 vars in 1190 bytes} [Thu May 19 13:47:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:47:27.842795 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-d5ac1264-2fd4-44b8-b18b-185ff164ffb1 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:27.843873 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-d5ac1264-2fd4-44b8-b18b-185ff164ffb1 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 May 19 13:47:27.844277 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 22/43] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:47:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:47:28.030921 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-04b6650e-37b3-448c-9652-3f578349a401 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:28.036705 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.wsgi [None req-04b6650e-37b3-448c-9652-3f578349a401 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-04b6650e-37b3-448c-9652-3f578349a401 admin admin] Request method failure captured: May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Accept: application/json May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Accept-Encoding: gzip, deflate May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Connection: keep-alive May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Content-Length: 0 May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Host: 10.222.0.52 May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Openstack-Api-Version: compute 2.90 May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Openstack-System-Scope: None May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: User-Agent: python-novaclient May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Auth-Token: gAAAAABihkpvgfNTf82hGjKi-V8rM6abo0Za-ymiFc3BnjFEfaiIBDjH7WdgdGygReuq5bi5_jBFHi03Lay23pgC6hIOhV1q7s5AVgWDp4bnnKAgcqs6wGllfXczJog5-hdkg_hwku6gpEL9UA4GsQbq-VGXMHej1GTM27JD55vcF5TtC75rL2I May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Domain-Id: None May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Domain-Name: None May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Identity-Status: Confirmed May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Is-Admin-Project: True May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Domain-Id: default May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Domain-Name: Default May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Name: admin May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Role: member,admin,reader May 19 13:47:28.038176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Roles: member,admin,reader May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}] May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Tenant: admin May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Tenant-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Tenant-Name: admin May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User: admin May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Domain-Id: default May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Domain-Name: Default May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Id: ea5484f975734ad68c3decb7b2d0c713 May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Name: admin May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: method: > May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: exception: Flavor 84 could not be found. May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: action_args: {'id': '84'} May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:47:28.039739 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:28.040812 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:28.042073 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-04b6650e-37b3-448c-9652-3f578349a401 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:47:28.043304 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-04b6650e-37b3-448c-9652-3f578349a401 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060737 May 19 13:47:28.043304 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 22/44] 10.222.0.52 () {60 vars in 1190 bytes} [Thu May 19 13:47:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:47:28.049291 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-730c0b9f-966a-40f9-8752-1ebfb4e638db admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:28.063842 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-730c0b9f-966a-40f9-8752-1ebfb4e638db admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018047 May 19 13:47:28.064320 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 23/45] 10.222.0.52 () {60 vars in 1210 bytes} [Thu May 19 13:47:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:47:28.073723 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-02d55881-abb2-4d7f-af67-85f10b0df59f admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:28.087841 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-02d55881-abb2-4d7f-af67-85f10b0df59f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017612 May 19 13:47:28.088366 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 23/46] 10.222.0.52 () {60 vars in 1210 bytes} [Thu May 19 13:47:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:47:28.098017 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-3171dcf3-71de-4068-9c8e-85a8a6b94ab9 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:28.103416 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.wsgi [None req-3171dcf3-71de-4068-9c8e-85a8a6b94ab9 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-3171dcf3-71de-4068-9c8e-85a8a6b94ab9 admin admin] Request method failure captured: May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Accept: application/json May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Accept-Encoding: gzip, deflate May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Connection: keep-alive May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Content-Length: 0 May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Host: 10.222.0.52 May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Openstack-Api-Version: compute 2.90 May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Openstack-System-Scope: None May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: User-Agent: python-novaclient May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Auth-Token: gAAAAABihkpvgfNTf82hGjKi-V8rM6abo0Za-ymiFc3BnjFEfaiIBDjH7WdgdGygReuq5bi5_jBFHi03Lay23pgC6hIOhV1q7s5AVgWDp4bnnKAgcqs6wGllfXczJog5-hdkg_hwku6gpEL9UA4GsQbq-VGXMHej1GTM27JD55vcF5TtC75rL2I May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Domain-Id: None May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Domain-Name: None May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Identity-Status: Confirmed May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Is-Admin-Project: True May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Domain-Id: default May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Domain-Name: Default May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Name: admin May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Role: member,admin,reader May 19 13:47:28.104953 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Roles: member,admin,reader May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}] May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Tenant: admin May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Tenant-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Tenant-Name: admin May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User: admin May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Domain-Id: default May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Domain-Name: Default May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Id: ea5484f975734ad68c3decb7b2d0c713 May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Name: admin May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: method: > May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: exception: Flavor 84 could not be found. May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: action_args: {'id': '84'} May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:47:28.106470 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:28.107419 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:28.108727 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-3171dcf3-71de-4068-9c8e-85a8a6b94ab9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:47:28.109903 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-3171dcf3-71de-4068-9c8e-85a8a6b94ab9 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012060 May 19 13:47:28.109903 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 24/47] 10.222.0.52 () {60 vars in 1190 bytes} [Thu May 19 13:47:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:47:28.990576 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-02d55881-abb2-4d7f-af67-85f10b0df59f admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:28.991622 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-02d55881-abb2-4d7f-af67-85f10b0df59f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 May 19 13:47:28.992023 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 24/48] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:47:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:47:29.181527 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-031b7601-0283-42f1-b1ec-74e3c3de11cd admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:29.188604 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.wsgi [None req-031b7601-0283-42f1-b1ec-74e3c3de11cd admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-031b7601-0283-42f1-b1ec-74e3c3de11cd admin admin] Request method failure captured: May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Accept: application/json May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Accept-Encoding: gzip, deflate May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Connection: keep-alive May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Content-Length: 0 May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Host: 10.222.0.52 May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Openstack-Api-Version: compute 2.90 May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Openstack-System-Scope: None May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: User-Agent: python-novaclient May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Auth-Token: gAAAAABihkpw09gUhmN26Spe4LOfsE2LD4K4BYg9o2-_ngKC2BdHSdE1Qlh5TPIvklvwnFXt3KAcMGtx43p4x36yPI8esXtTCXRYJgD_NekhwWobYjO9tFpTGmVBl8i6DXamhdA_94Q_EusVJUaFi9YDEQ7GTp62fILbUTdBuDQUoyB2uZEtcBs May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Domain-Id: None May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Domain-Name: None May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Identity-Status: Confirmed May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Is-Admin-Project: True May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Domain-Id: default May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Domain-Name: Default May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Project-Name: admin May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Role: member,admin,reader May 19 13:47:29.190076 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Roles: member,admin,reader May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}] May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Tenant: admin May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Tenant-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-Tenant-Name: admin May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User: admin May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Domain-Id: default May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Domain-Name: Default May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Id: ea5484f975734ad68c3decb7b2d0c713 May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: X-User-Name: admin May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: method: > May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: exception: Flavor 451 could not be found. May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: action_args: {'id': '451'} May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:47:29.191590 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:29.192511 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: ERROR nova.api.openstack.wsgi May 19 13:47:29.193641 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-031b7601-0283-42f1-b1ec-74e3c3de11cd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109324) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:47:29.194837 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-031b7601-0283-42f1-b1ec-74e3c3de11cd admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063236 May 19 13:47:29.194837 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 25/49] 10.222.0.52 () {60 vars in 1193 bytes} [Thu May 19 13:47:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:47:29.201437 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-72bc42dc-c34a-4dfe-a5c0-9d956dbef3d1 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:29.215505 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-72bc42dc-c34a-4dfe-a5c0-9d956dbef3d1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017323 May 19 13:47:29.216025 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 25/50] 10.222.0.52 () {60 vars in 1210 bytes} [Thu May 19 13:47:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:47:29.225007 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:29.238719 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017135 May 19 13:47:29.239275 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 26/51] 10.222.0.52 () {60 vars in 1210 bytes} [Thu May 19 13:47:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:47:29.248585 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-9935a3d7-674f-47c5-9616-630a9097b4f1 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:29.254084 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.wsgi [None req-9935a3d7-674f-47c5-9616-630a9097b4f1 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-9935a3d7-674f-47c5-9616-630a9097b4f1 admin admin] Request method failure captured: May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Accept: application/json May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Accept-Encoding: gzip, deflate May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Connection: keep-alive May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Content-Length: 0 May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Host: 10.222.0.52 May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Openstack-Api-Version: compute 2.90 May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Openstack-System-Scope: None May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: User-Agent: python-novaclient May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Auth-Token: gAAAAABihkpw09gUhmN26Spe4LOfsE2LD4K4BYg9o2-_ngKC2BdHSdE1Qlh5TPIvklvwnFXt3KAcMGtx43p4x36yPI8esXtTCXRYJgD_NekhwWobYjO9tFpTGmVBl8i6DXamhdA_94Q_EusVJUaFi9YDEQ7GTp62fILbUTdBuDQUoyB2uZEtcBs May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Domain-Id: None May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Domain-Name: None May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Identity-Status: Confirmed May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Is-Admin-Project: True May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Openstack-Nova-Api-Version: 2.90 May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Domain-Id: default May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Domain-Name: Default May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Project-Name: admin May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Role: member,admin,reader May 19 13:47:29.255597 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Roles: member,admin,reader May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/2f0d02746fbd4bebabb402313125d4b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/2f0d02746fbd4bebabb402313125d4b8"}]}] May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Tenant: admin May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Tenant-Id: 2f0d02746fbd4bebabb402313125d4b8 May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-Tenant-Name: admin May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User: admin May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Domain-Id: default May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Domain-Name: Default May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Id: ea5484f975734ad68c3decb7b2d0c713 May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: X-User-Name: admin May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: method: > May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: exception: Flavor 451 could not be found. May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: action_args: {'id': '451'} May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:47:29.257176 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:29.258320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: ERROR nova.api.openstack.wsgi May 19 13:47:29.259717 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-9935a3d7-674f-47c5-9616-630a9097b4f1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109323) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:47:29.260933 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-9935a3d7-674f-47c5-9616-630a9097b4f1 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012302 May 19 13:47:29.260933 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 26/52] 10.222.0.52 () {60 vars in 1193 bytes} [Thu May 19 13:47:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 13:47:30.138772 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:30.139807 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 19 13:47:30.140211 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:47:30.328069 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-9dd615ea-fd52-426b-9de7-b45aca0c31bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:47:30.349414 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-9dd615ea-fd52-426b-9de7-b45aca0c31bf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072907 May 19 13:47:30.350422 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 27/54] 10.222.0.52 () {64 vars in 1235 bytes} [Thu May 19 13:47:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:47:31.245061 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:31.246069 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 19 13:47:31.246554 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:47:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:47:31.438883 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-99028f4e-bcd4-4ee1-9312-8d93d01b82dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:47:31.456340 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-99028f4e-bcd4-4ee1-9312-8d93d01b82dc admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071667 May 19 13:47:31.456830 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 28/56] 10.222.0.52 () {64 vars in 1235 bytes} [Thu May 19 13:47:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:47:32.338453 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:32.340097 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 19 13:47:32.340462 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 29/57] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:47:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:47:32.530158 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-917532f6-67a1-4800-8d38-9a8a1572d470 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:47:32.547262 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-917532f6-67a1-4800-8d38-9a8a1572d470 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069594 May 19 13:47:32.547805 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 29/58] 10.222.0.52 () {64 vars in 1235 bytes} [Thu May 19 13:47:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:47:33.441151 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:33.442167 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 19 13:47:33.442591 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 30/59] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:47:33.632201 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-c127af5c-cb9c-444d-85d8-8a0c3fcb0718 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:47:33.649907 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-c127af5c-cb9c-444d-85d8-8a0c3fcb0718 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069342 May 19 13:47:33.650444 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 30/60] 10.222.0.52 () {64 vars in 1235 bytes} [Thu May 19 13:47:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:47:34.550201 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:34.551236 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 19 13:47:34.551644 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 31/61] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:47:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:47:34.739980 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-c5b82732-b831-4985-8c99-a5001c66927c admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:47:34.760042 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-c5b82732-b831-4985-8c99-a5001c66927c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073642 May 19 13:47:34.760843 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 31/62] 10.222.0.52 () {60 vars in 1202 bytes} [Thu May 19 13:47:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:48:37.073104 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:48:37.074499 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-6dc58928-32cb-4b6b-b6b1-8f4e1707b029 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002553 May 19 13:48:37.074932 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 930 bytes} [Thu May 19 13:48:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:48:37.082320 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:48:37.133900 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-0628c7e6-3ed7-41f4-b054-b7430b715b8a admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:48:37.153569 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-0628c7e6-3ed7-41f4-b054-b7430b715b8a admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072541 May 19 13:48:37.154276 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 32/64] 10.222.0.52 () {60 vars in 1291 bytes} [Thu May 19 13:48:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:48:37.175785 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG dbcounter [-] [109324] Writing DB stats nova_api:SELECT=14 {{(pid=109324) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:48:37.179583 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-9dc7b2b6-abad-416f-87ff-bcbb1fccb2bb admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:48:37.187910 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-9dc7b2b6-abad-416f-87ff-bcbb1fccb2bb admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013617 May 19 13:48:37.188456 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 33/65] 10.222.0.52 () {60 vars in 1282 bytes} [Thu May 19 13:48:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:48:37.200314 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-a6640ef4-c6e3-4104-beb2-ac231387af77 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:48:37.207866 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-a6640ef4-c6e3-4104-beb2-ac231387af77 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011770 May 19 13:48:37.208381 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 33/66] 10.222.0.52 () {60 vars in 1285 bytes} [Thu May 19 13:48:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:48:37.219411 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:48:37.226800 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010781 May 19 13:48:37.227354 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 34/67] 10.222.0.52 () {60 vars in 1285 bytes} [Thu May 19 13:48:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:48:37.238217 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-36721c4e-730c-4394-95ef-dafa7bc430f7 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:48:37.246159 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-36721c4e-730c-4394-95ef-dafa7bc430f7 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011368 May 19 13:48:37.246670 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 34/68] 10.222.0.52 () {60 vars in 1282 bytes} [Thu May 19 13:48:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:52:12.775648 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:52:12.776667 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 19 13:52:12.777077 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 35/69] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:52:12.938920 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_api:SELECT=6 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:52:13.050557 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-c4bdb2c4-e576-4721-bb9b-b81516e7bb25 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:52:13.051782 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:52:13.051782 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: warnings.warn(msg) May 19 13:52:13.052975 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-c4bdb2c4-e576-4721-bb9b-b81516e7bb25 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:52:13.053415 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-c4bdb2c4-e576-4721-bb9b-b81516e7bb25 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:52:13.054193 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-c4bdb2c4-e576-4721-bb9b-b81516e7bb25 admin admin] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:52:13.054619 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-c4bdb2c4-e576-4721-bb9b-b81516e7bb25 admin admin] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:52:13.089617 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-c4bdb2c4-e576-4721-bb9b-b81516e7bb25 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.152282 May 19 13:52:13.090186 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 35/70] 10.222.0.52 () {60 vars in 1193 bytes} [Thu May 19 13:52:12 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:52:13.985895 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:52:13.986927 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 19 13:52:13.987328 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 36/71] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:52:14.176123 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-85e70992-ffc2-48cf-8a3d-74768db0a46e admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:52:14.177283 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:52:14.177283 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: warnings.warn(msg) May 19 13:52:14.178462 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-85e70992-ffc2-48cf-8a3d-74768db0a46e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:52:14.178933 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-85e70992-ffc2-48cf-8a3d-74768db0a46e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:52:14.179725 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-85e70992-ffc2-48cf-8a3d-74768db0a46e admin admin] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:52:14.180208 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-85e70992-ffc2-48cf-8a3d-74768db0a46e admin admin] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:52:14.201051 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-85e70992-ffc2-48cf-8a3d-74768db0a46e admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075092 May 19 13:52:14.201600 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 36/72] 10.222.0.52 () {60 vars in 1193 bytes} [Thu May 19 13:52:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:52:25.519305 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:52:25.520304 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 19 13:52:25.520702 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:52:25.663148 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_cell0:SELECT=4 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:52:25.663774 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_cell1:SELECT=4 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:52:25.664547 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG dbcounter [-] [109323] Writing DB stats nova_api:SELECT=8 {{(pid=109323) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:52:25.713090 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-f15232d0-8833-45ea-b34a-96d01f5e5a9a admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:52:25.714243 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:52:25.714243 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: warnings.warn(msg) May 19 13:52:25.715466 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-f15232d0-8833-45ea-b34a-96d01f5e5a9a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:52:25.715907 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-f15232d0-8833-45ea-b34a-96d01f5e5a9a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:52:25.716688 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-f15232d0-8833-45ea-b34a-96d01f5e5a9a admin admin] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:52:25.717115 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-f15232d0-8833-45ea-b34a-96d01f5e5a9a admin admin] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:52:25.741281 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-f15232d0-8833-45ea-b34a-96d01f5e5a9a admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082651 May 19 13:52:25.741832 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 37/74] 10.222.0.52 () {60 vars in 1193 bytes} [Thu May 19 13:52:25 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:52:26.644868 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: DEBUG nova.api.openstack.wsgi [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] Calling method '>' {{(pid=109324) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:52:26.645920 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: INFO nova.api.openstack.requestlog [None req-150d4f02-4277-41cd-ad6e-4e0cdee53d85 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 May 19 13:52:26.651796 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: [pid: 109324|app: 0|req: 38/75] 10.222.0.52 () {56 vars in 1074 bytes} [Thu May 19 13:52:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:52:26.836483 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG nova.api.openstack.wsgi [None req-1e3f068f-1f65-4f79-bb1d-5f507adfb9d0 admin admin] Calling method '>' {{(pid=109323) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:52:26.837738 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 13:52:26.837738 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: warnings.warn(msg) May 19 13:52:26.838934 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-1e3f068f-1f65-4f79-bb1d-5f507adfb9d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:52:26.839369 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-1e3f068f-1f65-4f79-bb1d-5f507adfb9d0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:52:26.840169 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-1e3f068f-1f65-4f79-bb1d-5f507adfb9d0 admin admin] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:52:26.840589 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: DEBUG oslo_concurrency.lockutils [None req-1e3f068f-1f65-4f79-bb1d-5f507adfb9d0 admin admin] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109323) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:52:26.861420 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: INFO nova.api.openstack.requestlog [None req-1e3f068f-1f65-4f79-bb1d-5f507adfb9d0 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.076609 May 19 13:52:26.861955 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: [pid: 109323|app: 0|req: 38/76] 10.222.0.52 () {60 vars in 1193 bytes} [Thu May 19 13:52:26 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:53:24.708365 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: Thu May 19 13:53:24 2022 - graceful shutdown triggered... May 19 13:53:24.708475 dv-cinder-784815-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 19 13:53:24.709445 dv-cinder-784815-14-iscsi devstack@n-api.service[109323]: Gracefully killing worker 1 (pid: 109323)... May 19 13:53:24.710385 dv-cinder-784815-14-iscsi devstack@n-api.service[109324]: Gracefully killing worker 2 (pid: 109324)... May 19 13:53:25.708926 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: worker 1 buried after 1 seconds May 19 13:53:25.708926 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: worker 2 buried after 1 seconds May 19 13:53:25.708926 dv-cinder-784815-14-iscsi devstack@n-api.service[109322]: goodbye to uWSGI. May 19 13:53:25.710411 dv-cinder-784815-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 19 13:53:25.711011 dv-cinder-784815-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 19 13:53:25.713680 dv-cinder-784815-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 13:53:25.731541 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 13:53:25 2022] *** May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: nodename: dv-cinder-784815-14-iscsi May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: machine: x86_64 May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: clock source: unix May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: pcre jit disabled May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: detected number of CPU cores: 4 May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: current working directory: / May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: detected binary path: /usr/bin/uwsgi-core May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: your processes number limit is 47680 May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: your memory page size is 4096 bytes May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: detected max file descriptor number: 2048 May 19 13:53:25.755327 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: lock engine: pthread robust mutexes May 19 13:53:25.756487 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: thunder lock: enabled May 19 13:53:25.756487 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 13:53:25.756487 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 13:53:25.801865 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: Python main interpreter initialized at 0x55fc9f0c89c0 May 19 13:53:25.801865 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: python threads support enabled May 19 13:53:25.801865 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: your server socket listen backlog is limited to 100 connections May 19 13:53:25.801865 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: your mercy for graceful operations on workers is 90 seconds May 19 13:53:25.802305 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: mapped 403077 bytes (393 KB) for 2 cores May 19 13:53:25.802305 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: *** Operational MODE: preforking *** May 19 13:53:25.802554 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: *** uWSGI is running in multiple interpreter mode *** May 19 13:53:25.802554 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: spawned uWSGI master process (pid: 123733) May 19 13:53:25.802769 dv-cinder-784815-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 13:53:25.805595 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: spawned uWSGI worker 1 (pid: 123751, cores: 1) May 19 13:53:25.805595 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: spawned uWSGI worker 2 (pid: 123752, cores: 1) May 19 13:53:25.805595 dv-cinder-784815-14-iscsi devstack@n-api.service[123733]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 13:53:27.026143 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 13:53:27.033553 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 13:53:27.832835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:53:27.832835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: from cryptography.utils import int_from_bytes May 19 13:53:27.833133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:53:27.833133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: from cryptography.utils import int_from_bytes May 19 13:53:27.834454 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:53:27.834454 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: from cryptography.utils import int_from_bytes May 19 13:53:27.834777 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 13:53:27.834777 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: from cryptography.utils import int_from_bytes May 19 13:53:30.299075 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 13:53:30.300154 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 13:53:30.300698 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 13:53:30.301078 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 13:53:30.301343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 13:53:30.301741 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.302074 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.302404 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.302737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.303107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.303426 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.303754 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.304081 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.304294 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 13:53:30.304695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.304780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 13:53:30.304854 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.305031 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.305139 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 13:53:30.305335 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784815-14-iscsi {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.305454 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 13:53:30.305627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.305731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 13:53:30.305925 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.306043 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.306240 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.306409 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.306571 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.306727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.306916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.307032 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.307213 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.307388 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.307554 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.307705 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.307992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.308101 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.308321 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.308652 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.308916 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.309254 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.309576 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784815-14-iscsi {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.309765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.309888 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.310134 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.310359 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.310614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.310851 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.311131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.311340 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.311548 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.311771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.311993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.312210 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.312426 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.312660 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.312884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.312884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.313346 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.313596 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.313804 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.314013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784815-14-iscsi {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.314333 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.314548 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.314768 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.314933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.315126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.315273 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.315471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.315471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.315755 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.315901 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.316044 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.316220 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.316395 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.316550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.316695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.316839 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.316991 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.317151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784815-14-iscsi {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.317322 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.317474 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.317664 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.317811 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.317966 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.318142 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.318297 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.318297 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.318603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.318752 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.318949 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.319116 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.319287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.320241 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.320413 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.320562 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.320721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.320877 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.321023 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.321178 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.321331 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.321476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.321634 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.321779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.321923 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.322078 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.322223 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.322378 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.322523 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.322666 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.322822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.323021 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.323179 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.323336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.323491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.323645 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.323790 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.323944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.324103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.324248 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.324400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.324553 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.324697 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.324848 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.325006 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.325150 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.325301 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.325453 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.325615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.325784 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.325943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.326091 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.326247 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.326459 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.326614 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.326769 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.326985 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.327146 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.327292 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.327444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.327596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.327596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.327902 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.328053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.328205 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.328205 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.328493 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.328655 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.328808 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.328959 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.329103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.329254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.329418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.329601 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.330396 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.330552 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.330705 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.330851 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.331070 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.331228 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.331381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.331526 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.331680 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.331835 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.331994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.332145 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.332289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.332444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.332596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.332747 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.332909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.333063 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.333215 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.333368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.333519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.333678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.333824 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.334540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.334638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.334726 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.334809 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.334935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335024 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335098 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335175 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335253 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335411 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335494 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335565 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335641 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335719 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335799 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335879 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.335952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336164 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336241 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336324 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336396 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336474 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336553 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336632 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336719 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336791 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336860 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336929 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.336998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337156 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337238 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337309 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337386 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337526 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337607 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337840 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.337989 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.338066 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.338143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.338223 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.338302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.338374 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.338444 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.338580 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.338759 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.339093 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.339196 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.340517 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.340692 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.340852 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.341002 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.341716 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.341998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.342155 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.342313 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.342461 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.342614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.342767 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.342964 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.343127 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.343288 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.343483 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.343628 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.343774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.343919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.344063 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.344221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.344374 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.344519 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.344663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.344814 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.344971 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.345125 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.345270 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.345424 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.345569 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.345713 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.345870 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.346023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.346178 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.346331 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.346485 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.346637 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.346791 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.347011 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.347158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.347312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.347466 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.347613 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.347772 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.347917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.348101 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.348258 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.348403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.348546 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.348702 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.348846 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.349006 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.349151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.349296 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.349453 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.349606 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.349753 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.349912 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.349912 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.350779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.351054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 13:53:30.351330 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.351330 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.351641 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.351788 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.351933 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.352087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.352239 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.352392 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.352537 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.352688 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.352834 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.353008 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.353167 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.353321 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.353467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.353632 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.353799 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.353952 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.354097 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.354241 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.354392 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.354555 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.354710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.354900 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.355052 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.355198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.355353 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.355353 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.355638 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.355638 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.355927 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.355927 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.356199 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.356351 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.356502 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.356656 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.356930 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.357575 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.357730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.357876 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.358039 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.358198 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.358352 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.358504 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.358659 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.358804 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.358993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.359149 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.359305 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.359457 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.359610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.359763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.359936 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.359936 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.360930 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.361182 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.361350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.361502 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.361680 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.361680 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.362112 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.362262 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.362415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.362561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.362715 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.362901 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.363059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.363205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.363362 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.363518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.363663 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.363809 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.363953 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.364105 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.364260 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.364415 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.364561 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.364706 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.364867 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.365020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.365173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.365340 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.365497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.365497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.365771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.365922 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.366066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.366224 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.366377 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.366522 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.366667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.366828 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.367012 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.367012 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.367302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.367458 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.367604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.367748 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.367902 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.368047 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.368295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.368447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.368600 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.368753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.368922 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.369067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.369212 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.369355 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.369511 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.369664 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.369887 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.370042 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.370188 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.370807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.371125 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.371379 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.371547 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.371707 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.371860 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.372006 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.372151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.372313 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.372459 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.372611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.372758 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.372903 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.373285 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.373465 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.373613 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.373779 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.373926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.374078 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.374232 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.374389 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.374542 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.374688 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.374834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.375005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.375151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.375312 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.375462 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.375608 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.375769 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.375927 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.376086 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.376232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.376375 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.376530 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.376676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.376676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.376972 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.377125 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.377269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.377413 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.377817 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.377981 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.378136 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.378295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.378440 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.378583 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.378727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.378908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.379061 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.379205 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.379359 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.379505 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.379656 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.379828 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.379974 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.380119 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.380263 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.380406 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.381031 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.381300 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.381550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.381710 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.381856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.382057 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.382215 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.382373 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.382548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.382700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.382853 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.383024 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.383194 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.383646 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.383809 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.383963 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.384117 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.384271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.384431 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.384576 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.384871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.385045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.385207 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.385368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.385530 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.385530 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.385834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.385987 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.386145 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.386297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.386459 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.386618 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.386778 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.387001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.387167 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.387327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.387494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.387654 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.387814 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.387974 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.388184 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.388184 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.388735 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.388891 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.389042 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.389202 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.389961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.390130 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.390294 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.390454 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.397692 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.397692 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.398126 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.398289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.398453 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.398629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.398786 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.398970 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.399310 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.399483 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.399638 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.399806 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.399969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.400206 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.400376 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.400539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.400693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.401508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.401682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.401844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.401998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.402172 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.402327 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.402495 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.402649 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.402810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.403066 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.403066 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.405758 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.405845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.405920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406001 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406082 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406163 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406163 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406668 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406742 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406821 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406951 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.406951 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407092 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407176 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407251 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407328 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407328 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407473 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407628 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407708 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407708 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407843 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407914 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.407999 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408220 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408293 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408363 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408446 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408526 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408598 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408675 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408754 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.408834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.409057 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.409138 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.409222 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.409296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.409366 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.410405 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.410526 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.410638 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.410756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.410897 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.411047 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.411168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.411280 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.411399 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.411511 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.411634 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.411761 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.411874 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.412557 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.412693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.412832 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.412933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413382 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413475 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413652 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413735 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413735 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413895 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.413982 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414169 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414437 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414522 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414689 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414772 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414879 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.414981 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415242 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415333 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415510 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415688 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415777 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415861 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.415945 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416041 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416210 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416300 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416386 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416479 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416564 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416648 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.416994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417079 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417169 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417345 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417435 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417618 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417701 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417792 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417883 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.417883 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.418045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.418131 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.418221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.418359 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.418497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.418642 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.418773 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.418891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.418980 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.419087 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.419087 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.419262 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.420061 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.420815 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.420931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421026 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421223 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421321 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421419 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421607 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421693 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421787 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421875 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421962 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.421962 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.422145 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.422234 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.422319 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.422466 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.422595 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.422721 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.422846 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423012 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423105 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423105 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423410 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423410 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423578 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423664 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423759 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423857 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.423857 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424106 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424106 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424276 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424362 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424362 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424535 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424632 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424720 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.424980 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425370 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425542 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425542 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425711 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425804 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425804 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.425969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.426056 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.426056 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.427250 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428244 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428332 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428332 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428566 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428705 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428791 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428916 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.428916 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429097 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429351 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429702 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429788 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.429967 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430246 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430333 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430512 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430612 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430701 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430787 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.430934 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.431052 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.431135 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.431316 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.431416 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.431552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.431678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.431794 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.431916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.432049 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.432174 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.432270 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.432365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.432460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.432596 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.432778 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.432944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.433101 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.433255 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.433418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.433584 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.433738 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.433899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.434053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.434216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.434216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.434216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.434216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.434819 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.435102 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.435866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436034 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436206 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436307 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436397 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436495 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436584 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436779 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436876 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.436964 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437051 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437144 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437284 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437442 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437535 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437727 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.437822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.438285 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.438375 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.438375 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.438596 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.438691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.438778 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.438933 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.439059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.439193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.439311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.439311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.439523 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.439637 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.439767 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.439892 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.440007 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.440130 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.440245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443018 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443299 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443387 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443482 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443632 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443740 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.443916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444009 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444097 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444191 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444293 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444388 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444486 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444643 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444733 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444733 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.444907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445002 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445090 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445184 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445272 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445537 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445623 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445715 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445809 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.445905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.446635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.446635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.446820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.446938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447129 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447225 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447572 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447660 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447754 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.447926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.448144 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.448301 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.448462 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.448730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.448826 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.449082 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.449177 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.449391 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.450103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.450211 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.450302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.450397 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.450485 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.450627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.451273 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.451414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.451551 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.451713 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.451805 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.451805 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.451989 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.452109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.452304 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.452439 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.452734 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.452886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.453686 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.453794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.453893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.453990 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.454088 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.454184 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.454280 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.454368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.454454 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.454549 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.454652 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.454748 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.454905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.455043 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.455224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.455364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.455544 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.455685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.455861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.456005 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.456176 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.456322 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.456491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.456620 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.456804 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.456938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.457117 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.457250 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.457426 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.457581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.457755 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.457900 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.458070 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.458212 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.458377 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.458530 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.458691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.458837 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.459028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.459173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.459313 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.459484 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.459617 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.459928 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.460059 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.460251 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.460376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.460570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.460694 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.460882 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.460992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.461206 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.461350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.461523 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.461629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.461844 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.461949 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.462162 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.462256 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.462472 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.462568 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.462918 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.463036 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.463235 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.463329 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.463550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.463643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.463862 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.463959 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.464169 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.464271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.464475 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.464568 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.464787 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.464888 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.465112 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.465216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.465418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.465521 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.465727 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.465835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.466037 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.466134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.467238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.467391 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.467522 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.467648 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.467779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.467877 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.467974 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.468142 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.468234 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.468322 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.468549 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.468653 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.468964 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.469073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.469279 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.469406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.469590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.469683 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.469913 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.470017 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.470239 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.470341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.470562 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.470700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.470879 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.471023 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.471211 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.471317 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.471522 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.471627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.471848 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.471951 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.472173 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.472280 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.472488 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.472595 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.472803 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.472896 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.473109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.473211 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.473434 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.473529 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.473756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.473848 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.474072 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.474175 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.474394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.474491 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.474812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.474939 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.475160 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.475256 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.475477 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.475581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.475799 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.475891 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.476126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.476221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.476432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.476536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.476739 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.476842 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.477054 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.477153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.477357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.477457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.477663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.477813 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.477987 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.478091 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.478291 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.478392 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.478604 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.478699 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.478937 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.479053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.479249 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.479343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.479554 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.479656 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.479854 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.479957 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.480177 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.480270 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.480479 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.480579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.480801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.480904 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.481112 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.481204 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.481435 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.481567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.481789 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.482812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.482932 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.483037 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.483334 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.483430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.483644 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.483747 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.483954 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.484060 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.484264 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.484360 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.484573 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.484674 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.484881 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.484976 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.485225 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.485328 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.485536 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.485636 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.485864 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.485966 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.486185 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.486294 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.486518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.486612 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.486835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.487019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.487188 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.487326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.487516 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.487620 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.487834 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.487928 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.488144 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.488238 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.488454 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.488557 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.488766 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.488867 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.489075 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.489177 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.489386 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.489488 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.489692 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.489784 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.490001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.490096 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.490305 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.490399 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.490613 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.490706 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.490948 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.491058 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.491255 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.491359 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.491561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.491703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.491889 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.491984 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.492197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.492294 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.492504 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.492611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.492813 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.492916 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.493119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.493219 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.493427 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.493534 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.493734 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.493840 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.494077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.494174 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.494385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.494489 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.494712 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.494813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.495056 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.495150 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.495374 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.495487 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.495703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.495806 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.496013 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.496114 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.496332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.496428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.496649 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.496751 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.496967 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.497060 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.497281 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.497432 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.497672 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.498184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.498184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.498346 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.498449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.498546 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.498634 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.498728 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.498844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.498987 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.499184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.499280 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.499503 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.499756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.499899 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.500091 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.500367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.500469 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.500698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.500801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.501017 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.501125 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.501332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.501434 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.501645 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.501742 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.501957 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.502067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.502270 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.502371 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.502831 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.502997 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.503168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.503263 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.503481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.503584 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.503794 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.503890 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.504123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.504226 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.504446 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.504549 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.504768 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.504871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.505089 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.505184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.505405 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.505506 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.505720 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.505827 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.506034 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.506129 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.506350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.506444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.506676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.506820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.507019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.507124 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.507329 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.507420 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.507642 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.507743 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.507955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.508048 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.508269 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.508370 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.508580 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.508681 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.508893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.508995 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.509207 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.509346 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.509519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.509613 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.509831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.509971 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.510143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.510252 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.510459 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.510562 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.510773 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.510897 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.511125 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.511238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.511448 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.511541 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.511765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.511869 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.512079 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.512189 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.512394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.512598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.512714 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.512919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.513259 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.513692 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.513785 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.513873 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.513960 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.514047 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.514201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.514307 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.514526 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.514629 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.514841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.514997 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.515186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.515282 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.515514 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.515617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.515823 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.515926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.516129 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.516225 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.516436 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.516528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.516745 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.516853 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.517049 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.517143 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.517363 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.517504 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.517679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.517789 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.517983 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.518085 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.518303 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.518519 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.518615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.518893 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.519168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.519264 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.519520 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.519614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.519838 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.519944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.520159 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.520253 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.520473 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.520578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.520788 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.520891 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.521101 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.521201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.521415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.521511 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.521719 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.521821 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.522025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.522159 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.522332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.522433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.522641 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.522746 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.522972 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.523082 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.523283 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.523387 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.523590 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.523739 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.523898 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.523991 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.524201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.524309 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.524512 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.524606 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.524816 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.524918 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.525122 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.525230 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.525431 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.525533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.525735 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.525836 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.526039 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.526157 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.526344 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.526446 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.526646 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.526739 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.526977 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.527085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.527286 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.527379 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.527592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.527713 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.527901 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.527995 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.528204 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.528297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.528510 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.528602 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.529340 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.529805 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.529906 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.530005 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.530102 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.530243 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.530353 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.530444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.530597 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.530692 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.530943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.531042 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.531251 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.531347 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.531554 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.531647 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.531868 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.531977 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.532178 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.532329 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.532501 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.532603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.532812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.532921 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.533123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.533227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.533467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.533699 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.533847 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.534038 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.534297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.534393 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.534635 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.534737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.534982 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.535080 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.535319 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.535414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.535634 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.535736 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.535946 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.536040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.536255 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.536357 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.536562 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.536665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.536875 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.536969 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.537183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.537284 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.537492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.537634 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.537803 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.537900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.538109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.538202 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.538418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.538523 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.538726 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.538829 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.539060 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.539157 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.539369 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.539479 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.539679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.539775 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.539986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.540081 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.540296 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.540401 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.540605 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.540708 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.540918 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.541013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.541252 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.541347 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.541569 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.541662 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.541887 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.541989 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.542197 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.542291 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.542511 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.542613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.542815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.542936 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.543148 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.543251 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.543456 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.543598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.543765 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.543896 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.544081 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.544187 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.544985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.545156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.545410 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.545691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.545800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.546008 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.546104 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.546362 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.546492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.546680 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.546803 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.547033 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.547133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.547362 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.547473 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.547679 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.547822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.548003 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.548098 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.548318 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.548422 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.548636 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.548738 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.548961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.549055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.549323 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.549438 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.549606 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.549748 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.549914 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.550007 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.550225 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.550330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.550536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.550621 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.550853 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.550959 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.551191 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.551295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.551498 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.551592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.551808 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.551931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.552123 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.552241 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.552428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.552521 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.552731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.552828 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.553037 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.553139 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.553344 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.553439 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.553648 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.553755 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.553952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.554102 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.554256 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.554350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.554555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.554657 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.554957 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.555092 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.555986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.556111 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.556246 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.556380 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.556498 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.556613 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.556736 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.556834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.556923 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557115 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557210 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557298 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557392 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557494 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557583 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557669 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.557898 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.558017 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.558142 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.558238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.558375 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.558496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.558707 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.558809 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.559066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.559171 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.559383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.559487 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.559706 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.559846 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.560044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.560650 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.560758 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.560858 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.560955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.561053 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.561131 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.561246 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.561341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.561585 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.561681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.561894 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.561996 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.562216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.562317 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.562524 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.562619 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.562838 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.563017 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.563173 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.563269 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.563485 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.563580 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.563797 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.563900 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.564107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.564202 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.564431 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.564539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.564757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.564850 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.565062 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.565164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.565388 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.565492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.565705 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.565797 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.566020 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.566114 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.566335 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.566440 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.566649 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.566744 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.566999 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.567096 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.567312 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.567408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.567625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.567728 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.567939 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.568071 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.568256 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.568353 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.568568 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.568664 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.568885 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.569023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.569201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.569296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.569518 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.569613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.569842 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.569997 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.570156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.570259 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.570484 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.570587 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.570810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.570983 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.571184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.571280 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.571500 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.571594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.571825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.571928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.572143 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.572238 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.572453 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.572555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.572704 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 13:53:30.572809 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.573055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 13:53:30.573301 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 13:53:30.633796 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO dbcounter [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Registered counter for database nova_api May 19 13:53:30.633969 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO dbcounter [None req-fe18e409-b889-454c-9459-cef511534aba None None] Registered counter for database nova_api May 19 13:53:30.656048 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_db.sqlalchemy.engines [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:53:30.657050 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_db.sqlalchemy.engines [None req-fe18e409-b889-454c-9459-cef511534aba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:53:30.663899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writer thread running {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:53:30.664471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writer thread running {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:53:30.722322 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.context [None req-fe18e409-b889-454c-9459-cef511534aba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15aabb13-0547-4fea-a3a2-4403ba090ba7(cell1) {{(pid=123751) load_cells /opt/stack/nova/nova/context.py:464}} May 19 13:53:30.726836 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fe18e409-b889-454c-9459-cef511534aba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:53:30.728364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.context [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),15aabb13-0547-4fea-a3a2-4403ba090ba7(cell1) {{(pid=123752) load_cells /opt/stack/nova/nova/context.py:464}} May 19 13:53:30.728494 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fe18e409-b889-454c-9459-cef511534aba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:53:30.729240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fe18e409-b889-454c-9459-cef511534aba None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:53:30.731258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fe18e409-b889-454c-9459-cef511534aba None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:53:30.733422 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:53:30.733552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO dbcounter [None req-fe18e409-b889-454c-9459-cef511534aba None None] Registered counter for database nova_cell0 May 19 13:53:30.735063 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:53:30.735863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:53:30.737612 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO dbcounter [None req-fe18e409-b889-454c-9459-cef511534aba None None] Registered counter for database nova_cell1 May 19 13:53:30.737868 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:53:30.739912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO dbcounter [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Registered counter for database nova_cell0 May 19 13:53:30.744014 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO dbcounter [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Registered counter for database nova_cell1 May 19 13:53:30.745196 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_db.sqlalchemy.engines [None req-fe18e409-b889-454c-9459-cef511534aba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:53:30.746463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_db.sqlalchemy.engines [None req-fe18e409-b889-454c-9459-cef511534aba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:53:30.752810 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_db.sqlalchemy.engines [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:53:30.754502 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writer thread running {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:53:30.754998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_db.sqlalchemy.engines [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:53:30.755799 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writer thread running {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:53:30.759641 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writer thread running {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:53:30.907449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO dbcounter [None req-fe18e409-b889-454c-9459-cef511534aba None None] Registered counter for database nova_cell0 May 19 13:53:30.910216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writer thread running {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:53:30.914356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_db.sqlalchemy.engines [None req-fe18e409-b889-454c-9459-cef511534aba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:53:30.918941 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writer thread running {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:53:30.921434 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO dbcounter [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Registered counter for database nova_cell0 May 19 13:53:30.928215 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_db.sqlalchemy.engines [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 13:53:30.932502 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writer thread running {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 13:53:31.241088 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: WARNING keystonemiddleware.auth_token [None req-fe18e409-b889-454c-9459-cef511534aba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:53:31.249215 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: WARNING keystonemiddleware.auth_token [None req-fe18e409-b889-454c-9459-cef511534aba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:53:31.269413 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: WARNING keystonemiddleware.auth_token [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:53:31.277855 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: WARNING keystonemiddleware.auth_token [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:53:31.613607 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: WARNING keystonemiddleware.auth_token [None req-fe18e409-b889-454c-9459-cef511534aba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:53:31.619833 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: WARNING keystonemiddleware.auth_token [None req-fe18e409-b889-454c-9459-cef511534aba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:53:31.625247 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc9f0c89c0 pid: 123751 (default app) May 19 13:53:31.645069 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: WARNING keystonemiddleware.auth_token [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 13:53:31.651393 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: WARNING keystonemiddleware.auth_token [None req-485749a4-7b68-46de-ac05-8f77d2ed301a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 13:53:31.657965 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fc9f0c89c0 pid: 123752 (default app) May 19 13:54:13.047408 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=3 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:13.049098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=3 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:13.050374 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=3 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:13.051779 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=3 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:13.577103 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:13.578741 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:13.580505 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:13.581329 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:14.295685 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-083c8ec7-fe3a-46b3-9791-c52561b2225f tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Action: 'create', calling method: .version_select at 0x7f5de4445550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-874185062", "metadata": {"Type": "work"}}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-083c8ec7-fe3a-46b3-9791-c52561b2225f tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Request method failure captured: May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 121 May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwEFP53Dhctr7Xx3FdzhN5qImd9UETbvXhb24Va7lCsk7VlPkrd_dOEVAy_Wa85xE-7qRfTfa_VebLUvqlYqtIq4Rk5Sulyb9HKomK4Fpb_tJ3I64kMt9dNETvn4xWe5cn1Lzo2eKnsWZAii9TLK2G-8_T7JFbPflNPn8F55UCWM_c May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:54:14.322080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}] May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesNegativeTest-1020640161 May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 264a78e35a654cfea772c2a1d4f8a0d9 May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-874185062", "metadata": {"Type": "work"}}} May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: May 19 13:54:14.326054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-874185062', 'metadata': {'Type': 'work'}}}} May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise error May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi '#$%' May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:14.327385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 13:54:14.328992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 13:54:14.330428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 13:54:14.330428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.330428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-083c8ec7-fe3a-46b3-9791-c52561b2225f tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:14.330428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-083c8ec7-fe3a-46b3-9791-c52561b2225f tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.292350 May 19 13:54:14.330428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Thu May 19 13:54:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1295 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 13:54:14.350249 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2e40415a-289b-48ac-9ae3-0448da080280 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Action: 'create', calling method: .version_select at 0x7f5de43788b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-805561633", "metadata": {"Type": "work"}}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2e40415a-289b-48ac-9ae3-0448da080280 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Request method failure captured: May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 119 May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwEFP53Dhctr7Xx3FdzhN5qImd9UETbvXhb24Va7lCsk7VlPkrd_dOEVAy_Wa85xE-7qRfTfa_VebLUvqlYqtIq4Rk5Sulyb9HKomK4Fpb_tJ3I64kMt9dNETvn4xWe5cn1Lzo2eKnsWZAii9TLK2G-8_T7JFbPflNPn8F55UCWM_c May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:54:14.353250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}] May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesNegativeTest-1020640161 May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 264a78e35a654cfea772c2a1d4f8a0d9 May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-805561633", "metadata": {"Type": "work"}}} May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: May 19 13:54:14.354712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-805561633', 'metadata': {'Type': 'work'}}}} May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise error May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi '0' May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:14.356326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 13:54:14.357683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 13:54:14.360774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 13:54:14.360774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.360774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2e40415a-289b-48ac-9ae3-0448da080280 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:14.360774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2e40415a-289b-48ac-9ae3-0448da080280 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017663 May 19 13:54:14.362991 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 2/2] 10.222.0.52 () {60 vars in 1155 bytes} [Thu May 19 13:54:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 13:54:14.368671 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-72af7cb3-516f-481e-a530-a25775e5e193 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Action: 'create', calling method: .version_select at 0x7f5de44458b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1235155547", "metadata": {"Type": "work"}}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-72af7cb3-516f-481e-a530-a25775e5e193 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Request method failure captured: May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 119 May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwEFP53Dhctr7Xx3FdzhN5qImd9UETbvXhb24Va7lCsk7VlPkrd_dOEVAy_Wa85xE-7qRfTfa_VebLUvqlYqtIq4Rk5Sulyb9HKomK4Fpb_tJ3I64kMt9dNETvn4xWe5cn1Lzo2eKnsWZAii9TLK2G-8_T7JFbPflNPn8F55UCWM_c May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:54:14.371185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}] May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesNegativeTest-1020640161 May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 264a78e35a654cfea772c2a1d4f8a0d9 May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1235155547", "metadata": {"Type": "work"}}} May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: May 19 13:54:14.372990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1235155547', 'metadata': {'Type': 'work'}}}} May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise error May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi '' May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:14.373874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 13:54:14.375171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 13:54:14.376275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 13:54:14.376275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:14.376275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-72af7cb3-516f-481e-a530-a25775e5e193 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:14.376275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-72af7cb3-516f-481e-a530-a25775e5e193 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008633 May 19 13:54:14.376275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 3/3] 10.222.0.52 () {60 vars in 1155 bytes} [Thu May 19 13:54:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 13:54:14.383014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c6447302-0468-4df9-9eb9-dc221d6708fa tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Calling method '.version_select at 0x7f5de4370550>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:15.225224 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-968644eb-b9dd-48e2-bb64-e9363956feee tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Action: 'create', calling method: .version_select at 0x7f5de44454c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-206504979"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:15.335197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-c6447302-0468-4df9-9eb9-dc221d6708fa tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] HTTP exception thrown: Volume tempest-invalid-88918382 could not be found. May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c6447302-0468-4df9-9eb9-dc221d6708fa tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Request method failure captured: May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-88918382 HTTP/1.1 May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwEFP53Dhctr7Xx3FdzhN5qImd9UETbvXhb24Va7lCsk7VlPkrd_dOEVAy_Wa85xE-7qRfTfa_VebLUvqlYqtIq4Rk5Sulyb9HKomK4Fpb_tJ3I64kMt9dNETvn4xWe5cn1Lzo2eKnsWZAii9TLK2G-8_T7JFbPflNPn8F55UCWM_c May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:54:15.341954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}] May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesNegativeTest-1020640161 May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 264a78e35a654cfea772c2a1d4f8a0d9 May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Volume tempest-invalid-88918382 could not be found. May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': 'tempest-invalid-88918382'} May 19 13:54:15.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-88918382 could not be found. (HTTP 404) (Request-ID: req-fc96cd9c-0911-4653-b936-7f14836a29f1) May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:15.344684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:54:15.346025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-88918382 could not be found. May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:54:15.347381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-88918382 could not be found. May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-88918382 could not be found. May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c6447302-0468-4df9-9eb9-dc221d6708fa tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Returning 404 to user: Volume tempest-invalid-88918382 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:15.348543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c6447302-0468-4df9-9eb9-dc221d6708fa tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-88918382" status: 404 len: 97 microversion: 2.1 time: 0.964568 May 19 13:54:15.352367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 4/4] 10.222.0.52 () {58 vars in 1211 bytes} [Thu May 19 13:54:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-88918382 => generated 97 bytes in 974 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 19 13:54:15.365619 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8184e943-39e5-4c02-8cd3-904c6d9f6303 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011996 May 19 13:54:15.375607 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 5/5] 10.222.0.52 () {58 vars in 1139 bytes} [Thu May 19 13:54:15 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 13:54:15.391572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f2536cb6-a042-4f15-a5bc-d826ba9ae4d5 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012266 May 19 13:54:15.404069 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 6/6] 10.222.0.52 () {58 vars in 1136 bytes} [Thu May 19 13:54:15 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 19 13:54:15.418043 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e139208b-737d-4bfa-b181-303d26388e33 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Calling method '.version_select at 0x7f5de429fa60>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:16.160303 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-e139208b-737d-4bfa-b181-303d26388e33 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] HTTP exception thrown: Volume ab96eda9-fde2-4f2e-a4e8-64f0c85375ac could not be found. May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e139208b-737d-4bfa-b181-303d26388e33 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Request method failure captured: May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/os-volumes/ab96eda9-fde2-4f2e-a4e8-64f0c85375ac HTTP/1.1 May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwEFP53Dhctr7Xx3FdzhN5qImd9UETbvXhb24Va7lCsk7VlPkrd_dOEVAy_Wa85xE-7qRfTfa_VebLUvqlYqtIq4Rk5Sulyb9HKomK4Fpb_tJ3I64kMt9dNETvn4xWe5cn1Lzo2eKnsWZAii9TLK2G-8_T7JFbPflNPn8F55UCWM_c May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:54:16.163528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}] May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesNegativeTest-1020640161 May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 264a78e35a654cfea772c2a1d4f8a0d9 May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Volume ab96eda9-fde2-4f2e-a4e8-64f0c85375ac could not be found. May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': 'ab96eda9-fde2-4f2e-a4e8-64f0c85375ac'} May 19 13:54:16.164731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab96eda9-fde2-4f2e-a4e8-64f0c85375ac could not be found. (HTTP 404) (Request-ID: req-96d172cf-4cab-400c-935c-e58d4ed1fdbe) May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:16.165579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:54:16.166683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab96eda9-fde2-4f2e-a4e8-64f0c85375ac could not be found. May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 13:54:16.167815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab96eda9-fde2-4f2e-a4e8-64f0c85375ac could not be found. May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab96eda9-fde2-4f2e-a4e8-64f0c85375ac could not be found. May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e139208b-737d-4bfa-b181-303d26388e33 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Returning 404 to user: Volume ab96eda9-fde2-4f2e-a4e8-64f0c85375ac could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e139208b-737d-4bfa-b181-303d26388e33 tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/ab96eda9-fde2-4f2e-a4e8-64f0c85375ac" status: 404 len: 109 microversion: 2.1 time: 0.760083 May 19 13:54:16.173407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 7/7] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 13:54:15 2022] DELETE /compute/v2.1/os-volumes/ab96eda9-fde2-4f2e-a4e8-64f0c85375ac => generated 109 bytes in 767 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:54:16.185206 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-309f1840-cbd4-4714-b629-68bf452891da tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Calling method '.version_select at 0x7f5de429fee0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:16.599033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-309f1840-cbd4-4714-b629-68bf452891da tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] HTTP exception thrown: Volume 26f8998c-bac7-41f6-8767-4e796a71210b could not be found. May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-309f1840-cbd4-4714-b629-68bf452891da tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Request method failure captured: May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/os-volumes/26f8998c-bac7-41f6-8767-4e796a71210b HTTP/1.1 May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwEFP53Dhctr7Xx3FdzhN5qImd9UETbvXhb24Va7lCsk7VlPkrd_dOEVAy_Wa85xE-7qRfTfa_VebLUvqlYqtIq4Rk5Sulyb9HKomK4Fpb_tJ3I64kMt9dNETvn4xWe5cn1Lzo2eKnsWZAii9TLK2G-8_T7JFbPflNPn8F55UCWM_c May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:54:16.603289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d5a0c47cbf434c64a59b1ce21027ce70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d5a0c47cbf434c64a59b1ce21027ce70"}]}] May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesNegativeTest-1020640161 May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: d5a0c47cbf434c64a59b1ce21027ce70 May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesNegativeTest-1020640161 May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 264a78e35a654cfea772c2a1d4f8a0d9 May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesNegativeTest-1020640161-project May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Volume 26f8998c-bac7-41f6-8767-4e796a71210b could not be found. May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '26f8998c-bac7-41f6-8767-4e796a71210b'} May 19 13:54:16.604591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 26f8998c-bac7-41f6-8767-4e796a71210b could not be found. (HTTP 404) (Request-ID: req-dd061921-c83c-4e8c-bb9e-def2ab5ed389) May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:16.605339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:54:16.607197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 26f8998c-bac7-41f6-8767-4e796a71210b could not be found. May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 13:54:16.608305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 26f8998c-bac7-41f6-8767-4e796a71210b could not be found. May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 26f8998c-bac7-41f6-8767-4e796a71210b could not be found. May 19 13:54:16.609462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:16.612282 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-309f1840-cbd4-4714-b629-68bf452891da tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] Returning 404 to user: Volume 26f8998c-bac7-41f6-8767-4e796a71210b could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:16.613367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-309f1840-cbd4-4714-b629-68bf452891da tempest-VolumesNegativeTest-1020640161 tempest-VolumesNegativeTest-1020640161-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/26f8998c-bac7-41f6-8767-4e796a71210b" status: 404 len: 109 microversion: 2.1 time: 0.440289 May 19 13:54:16.614689 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 8/8] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 13:54:16 2022] GET /compute/v2.1/os-volumes/26f8998c-bac7-41f6-8767-4e796a71210b => generated 109 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:54:17.489612 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1519760547", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "networks": [{"uuid": "70b884c2-f81a-46c8-b02a-cbd78cb207ae"}]}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:17.652091 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] validate_networks() for [('70b884c2-f81a-46c8-b02a-cbd78cb207ae', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:54:17.782425 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-968644eb-b9dd-48e2-bb64-e9363956feee tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.214501 May 19 13:54:17.783090 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 1/9] 10.222.0.52 () {60 vars in 1154 bytes} [Thu May 19 13:54:13 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4217 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 19 13:54:17.796595 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2d225864-8340-4db1-834e-a5bec5b4c2cd tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de430e4c0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:17.904757 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2d225864-8340-4db1-834e-a5bec5b4c2cd tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b" status: 200 len: 344 microversion: 2.1 time: 0.113283 May 19 13:54:17.909722 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 2/10] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 13:54:17 2022] GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b => generated 344 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:18.922989 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2392b6cf-268f-477a-9671-49ef251f96bf tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de430e700>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:18.952778 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:54:18.953238 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:54:18.953774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:54:18.954405 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:54:18.955029 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:54:18.986822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:18.994491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:18.995419 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:18.997229 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:19.097293 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Getting quotas for project 89676dbc35634ec7994040c93f693f7c. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:54:19.115218 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Getting quotas for user fd88c8e9166940d8a09657997e6214d6 and project 89676dbc35634ec7994040c93f693f7c. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:54:19.140781 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2392b6cf-268f-477a-9671-49ef251f96bf tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b" status: 200 len: 345 microversion: 2.1 time: 0.225324 May 19 13:54:19.141705 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 3/11] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 13:54:18 2022] GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b => generated 345 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:54:19.143930 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:54:19.147469 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:54:19.154286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e012a2ac-8348-4338-93a3-2249a50e3206 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Action: 'create', calling method: .version_select at 0x7f5de430eb80>, body: {"snapshot": {"volume_id": "3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-803819158"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:19.380200 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-10e168c5-7f8b-4328-b7fb-9f7769db071f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.172860 May 19 13:54:19.383240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 9/12] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:54:19.409064 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-11bd3a94-a361-478d-85e8-5a915243d59b tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:19.412308 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-11bd3a94-a361-478d-85e8-5a915243d59b tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:19.626878 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-11bd3a94-a361-478d-85e8-5a915243d59b tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:19.661976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-11bd3a94-a361-478d-85e8-5a915243d59b tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1215 microversion: 2.1 time: 0.268464 May 19 13:54:19.663098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 10/13] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:19 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1215 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:19.785099 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e012a2ac-8348-4338-93a3-2249a50e3206 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.635948 May 19 13:54:19.786163 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 4/14] 10.222.0.52 () {60 vars in 1161 bytes} [Thu May 19 13:54:19 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:19.796670 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3a7eb0ae-487a-40cb-a5ed-098be66e5dd7 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de313e940>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:19.910698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3a7eb0ae-487a-40cb-a5ed-098be66e5dd7 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 286 microversion: 2.1 time: 0.118475 May 19 13:54:19.911331 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 11/15] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:19 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:19.923486 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b510b0eb-cb6c-44c4-bc67-b3bc244c4e52 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de4325790>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:20.018933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b510b0eb-cb6c-44c4-bc67-b3bc244c4e52 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.101818 May 19 13:54:20.019798 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 5/16] 10.222.0.52 () {58 vars in 1139 bytes} [Thu May 19 13:54:19 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:20.030002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2758c3d9-a61c-4502-984a-723da253509c tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de3154c10>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:20.090427 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2758c3d9-a61c-4502-984a-723da253509c tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 286 microversion: 2.1 time: 0.063316 May 19 13:54:20.090814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 12/17] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:20 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:20.681783 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7502aa13-1ca0-4783-82e5-0ecfc68d459b tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:20.682542 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7502aa13-1ca0-4783-82e5-0ecfc68d459b tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:20.873780 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7502aa13-1ca0-4783-82e5-0ecfc68d459b tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:20.898702 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7502aa13-1ca0-4783-82e5-0ecfc68d459b tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1215 microversion: 2.1 time: 0.221823 May 19 13:54:20.904423 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 6/18] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:20 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1215 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:21.102797 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8b36ba0c-87a8-4733-a32a-f85ad868cdf0 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de315d310>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:21.156831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8b36ba0c-87a8-4733-a32a-f85ad868cdf0 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 286 microversion: 2.1 time: 0.059057 May 19 13:54:21.157920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 13/19] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:21 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:21.918886 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6577efff-5697-448c-9f2d-35be7d55c846 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:21.920525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6577efff-5697-448c-9f2d-35be7d55c846 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:21.930611 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6577efff-5697-448c-9f2d-35be7d55c846 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:21.931166 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6577efff-5697-448c-9f2d-35be7d55c846 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:21.932956 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6577efff-5697-448c-9f2d-35be7d55c846 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:21.933395 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6577efff-5697-448c-9f2d-35be7d55c846 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:22.128776 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6577efff-5697-448c-9f2d-35be7d55c846 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:22.143957 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6577efff-5697-448c-9f2d-35be7d55c846 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1219 microversion: 2.1 time: 0.230133 May 19 13:54:22.145179 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 7/20] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:21 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1219 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:22.174182 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-019c80f2-9158-4327-8766-c7fe740e7043 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de3154c10>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:22.212616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-019c80f2-9158-4327-8766-c7fe740e7043 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 286 microversion: 2.1 time: 0.042497 May 19 13:54:22.213592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 14/21] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:22 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:23.162222 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8d9dca4e-ede8-48a6-bdf4-1bb5cc80da5a tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:23.163204 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8d9dca4e-ede8-48a6-bdf4-1bb5cc80da5a tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:23.178536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8d9dca4e-ede8-48a6-bdf4-1bb5cc80da5a tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:23.179009 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8d9dca4e-ede8-48a6-bdf4-1bb5cc80da5a tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:23.179971 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8d9dca4e-ede8-48a6-bdf4-1bb5cc80da5a tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:23.180538 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8d9dca4e-ede8-48a6-bdf4-1bb5cc80da5a tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:23.225121 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f8d0791e-3d79-4a1f-b2e5-2edbc797d283 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de313e940>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:23.315050 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f8d0791e-3d79-4a1f-b2e5-2edbc797d283 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 286 microversion: 2.1 time: 0.093752 May 19 13:54:23.315953 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 15/22] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:23 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:54:23.507357 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8d9dca4e-ede8-48a6-bdf4-1bb5cc80da5a tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:23.516762 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8d9dca4e-ede8-48a6-bdf4-1bb5cc80da5a tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1211 microversion: 2.1 time: 0.358642 May 19 13:54:23.520666 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 8/23] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:23 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1211 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:24.327807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-751586a8-d09f-422f-bd64-51e63e32232b tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de315d4c0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:24.390305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-751586a8-d09f-422f-bd64-51e63e32232b tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 286 microversion: 2.1 time: 0.067177 May 19 13:54:24.391352 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 16/24] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:24 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:24.538321 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-85c7034a-f39a-4aa2-ac53-aa17f4116714 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:24.539498 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-85c7034a-f39a-4aa2-ac53-aa17f4116714 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:24.557985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85c7034a-f39a-4aa2-ac53-aa17f4116714 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:24.559636 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85c7034a-f39a-4aa2-ac53-aa17f4116714 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:24.563953 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85c7034a-f39a-4aa2-ac53-aa17f4116714 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:24.566113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85c7034a-f39a-4aa2-ac53-aa17f4116714 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:24.714721 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-85c7034a-f39a-4aa2-ac53-aa17f4116714 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:24.724053 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-85c7034a-f39a-4aa2-ac53-aa17f4116714 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1267 microversion: 2.1 time: 0.190038 May 19 13:54:24.724635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 9/25] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:24 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:25.404926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cc21f41d-2275-447d-9372-ec9797d6f173 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de43258b0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:25.487850 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cc21f41d-2275-447d-9372-ec9797d6f173 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 286 microversion: 2.1 time: 0.089166 May 19 13:54:25.489217 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 10/26] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:25 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:25.661968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-49534207", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:25.742888 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-db392677-8cb2-4b99-935f-cdd98683270e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:25.744680 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-db392677-8cb2-4b99-935f-cdd98683270e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:25.759339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] validate_networks() for [('34a01e8b-7928-4301-ae0a-d1e9be21f258', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:54:25.773269 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db392677-8cb2-4b99-935f-cdd98683270e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:25.776278 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db392677-8cb2-4b99-935f-cdd98683270e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:25.779417 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db392677-8cb2-4b99-935f-cdd98683270e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:25.781866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db392677-8cb2-4b99-935f-cdd98683270e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:26.219598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-db392677-8cb2-4b99-935f-cdd98683270e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:26.236781 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-db392677-8cb2-4b99-935f-cdd98683270e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1267 microversion: 2.1 time: 0.499617 May 19 13:54:26.238916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 11/27] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:25 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1267 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:26.500552 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2e442fe2-070b-45a1-a805-f5408ce20eaf tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de42164c0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:26.563471 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2e442fe2-070b-45a1-a805-f5408ce20eaf tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 287 microversion: 2.1 time: 0.067548 May 19 13:54:26.569408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 12/28] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:26 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:26.576082 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-611c7861-5752-4652-a680-7ded96b275b5 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de41c7790>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:26.677877 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-611c7861-5752-4652-a680-7ded96b275b5 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 202 len: 0 microversion: 2.1 time: 0.107132 May 19 13:54:26.678478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 13/29] 10.222.0.52 () {58 vars in 1253 bytes} [Thu May 19 13:54:26 2022] DELETE /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:54:26.695935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-68b121d0-481b-4250-9659-50373ab87373 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de41f5dc0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:26.770987 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-68b121d0-481b-4250-9659-50373ab87373 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 286 microversion: 2.1 time: 0.087448 May 19 13:54:26.771869 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 14/30] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:26 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:54:27.265847 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-085da644-0425-491c-9050-b90325d8acfe tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:27.266464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-085da644-0425-491c-9050-b90325d8acfe tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:27.287698 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-085da644-0425-491c-9050-b90325d8acfe tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:27.288167 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-085da644-0425-491c-9050-b90325d8acfe tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:27.295085 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-085da644-0425-491c-9050-b90325d8acfe tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:27.295671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-085da644-0425-491c-9050-b90325d8acfe tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:27.311706 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:54:27.312954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:54:27.313471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:54:27.313888 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:54:27.314307 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:54:27.333561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:27.334444 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:27.338561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:27.339344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:27.405019 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Getting quotas for project 28027af4cc0c4ca99035e48aa6237805. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:54:27.426619 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Getting quotas for user 698ccea06fb24beea18c679d53f907a6 and project 28027af4cc0c4ca99035e48aa6237805. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:54:27.452993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-085da644-0425-491c-9050-b90325d8acfe tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:27.456287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:54:27.459639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:54:27.468820 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-085da644-0425-491c-9050-b90325d8acfe tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1275 microversion: 2.1 time: 0.218037 May 19 13:54:27.472068 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 15/31] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:27 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1275 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:27.587495 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8be9e1d6-31c4-4ca6-99f8-1db9cc8c42ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.255249 May 19 13:54:27.590365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 17/32] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:54:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:54:27.612804 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-aab9681f-83d9-4141-9f38-34b9d37c1ea9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:27.614239 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-aab9681f-83d9-4141-9f38-34b9d37c1ea9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:27.773675 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-aab9681f-83d9-4141-9f38-34b9d37c1ea9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:27.786681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-aab9681f-83d9-4141-9f38-34b9d37c1ea9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1220 microversion: 2.1 time: 0.188882 May 19 13:54:27.787972 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 18/33] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:27 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1220 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:27.803735 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-cce2cda6-4aed-4dab-9333-4daaa9573524 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de315df70>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:27.861093 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-cce2cda6-4aed-4dab-9333-4daaa9573524 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 200 len: 286 microversion: 2.1 time: 0.067955 May 19 13:54:27.863518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 19/34] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:27 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:27.998302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1665787605", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:28.082440 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] validate_networks() for [('34a01e8b-7928-4301-ae0a-d1e9be21f258', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:54:28.183606 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8538d01a-fc07-4921-a829-fe357f0c40bc tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'create', calling method: .version_select at 0x7f5de41c7e50>, body: {"keypair": {"name": "tempest-keypair-1285268638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxBGBZOoBdGNnmsbItqdvU/s+QJymKabJKclcrynMoa7QqBtbIBGYFPW4E1XhmBU4f2j2HIZ95E4CRuWzPOHNZKr6amtVZfmmsqPKtUjDA+lHRoEB17iciTtfLEW3pI1g=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:28.370605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-8538d01a-fc07-4921-a829-fe357f0c40bc tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Getting quotas for project 4eed7a893f7b42edaadbf898ebe16cd6. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:54:28.396429 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-8538d01a-fc07-4921-a829-fe357f0c40bc tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Getting quotas for user 00b21c3634cc41aca680152740644168 and project 4eed7a893f7b42edaadbf898ebe16cd6. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:54:28.478769 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8538d01a-fc07-4921-a829-fe357f0c40bc tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.927944 May 19 13:54:28.482697 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 16/35] 10.222.0.52 () {62 vars in 1199 bytes} [Thu May 19 13:54:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 933 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 13:54:28.510917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a185190b-4ac3-4fa9-9c38-0679fdcaf5e9 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:28.511725 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a185190b-4ac3-4fa9-9c38-0679fdcaf5e9 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:28.519207 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a185190b-4ac3-4fa9-9c38-0679fdcaf5e9 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:28.525481 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a185190b-4ac3-4fa9-9c38-0679fdcaf5e9 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:28.532872 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a185190b-4ac3-4fa9-9c38-0679fdcaf5e9 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:28.533488 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a185190b-4ac3-4fa9-9c38-0679fdcaf5e9 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:28.721023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a185190b-4ac3-4fa9-9c38-0679fdcaf5e9 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:28.731445 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a185190b-4ac3-4fa9-9c38-0679fdcaf5e9 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1275 microversion: 2.1 time: 0.246883 May 19 13:54:28.732106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 17/36] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:28 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1275 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:29.315389 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fa66cb2e-3aae-4d71-bf91-de85579e332b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: .version_select at 0x7f5de41a69d0>, body: {"keypair": {"name": "tempest-keypair-400520829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAz+WRWwiBgCfY+kZhZCXKdQzsmZxt0PBNdWi1SkhIKsnC6fEj+dJoeHDV3xS4oc6FmPm8MC2GDekcTrBQ2TrUemwBUE8Yuiq+8HqpZ8U3iRbwsYMcnCAmVkaCXQcAqsg=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:29.350899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-fa66cb2e-3aae-4d71-bf91-de85579e332b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for project 89b4336043d5446b922432a2f43af17a. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:54:29.370506 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-fa66cb2e-3aae-4d71-bf91-de85579e332b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for user 0cc3e0105f2a472092423852b1f39979 and project 89b4336043d5446b922432a2f43af17a. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:54:29.417103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:54:29.423641 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:54:29.425220 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:54:29.426447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:54:29.427440 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:54:29.441309 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:29.442595 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:29.443698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:29.444324 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:29.486006 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Getting quotas for project 28027af4cc0c4ca99035e48aa6237805. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:54:29.520645 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Getting quotas for user 698ccea06fb24beea18c679d53f907a6 and project 28027af4cc0c4ca99035e48aa6237805. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:54:29.523890 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fa66cb2e-3aae-4d71-bf91-de85579e332b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.777658 May 19 13:54:29.526220 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 13:54:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:29.549894 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-afdb116c-7931-4d59-ac1b-ecadea32bd28 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de395f430>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:29.603411 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:54:29.620924 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:54:29.627418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-afdb116c-7931-4d59-ac1b-ecadea32bd28 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] HTTP exception thrown: Snapshot c2257b6c-717a-43da-9e6e-b2a4ca759e75 could not be found. May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-afdb116c-7931-4d59-ac1b-ecadea32bd28 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Request method failure captured: May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 HTTP/1.1 May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwFz7_bgjhyIDBEf0YFqyyI_DYNIljY_o4r8MFpXhREKNE7PmzMjanDlCLWPvma6QCJELrAZWVLlL_9UGYNqJ2XFCwnNxU22rYFoJA8P76XN9SZzbhk-HYSmodVqn4YE0hDVLnH3zlv5UWLnA5z4sBU7pyPoN16iOjlTM7m0jKf0GE May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 4ea632c21d7549c89749672a6f65996d May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:54:29.632730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ea632c21d7549c89749672a6f65996d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ea632c21d7549c89749672a6f65996d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ea632c21d7549c89749672a6f65996d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ea632c21d7549c89749672a6f65996d"}]}] May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 4ea632c21d7549c89749672a6f65996d May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesSnapshotsTestJSON-1253875260-project May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: c3b964fb4e024354ba066b38537d2da9 May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1253875260-project May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Snapshot c2257b6c-717a-43da-9e6e-b2a4ca759e75 could not be found. May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': 'c2257b6c-717a-43da-9e6e-b2a4ca759e75'} May 19 13:54:29.633863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c2257b6c-717a-43da-9e6e-b2a4ca759e75 could not be found. (HTTP 404) (Request-ID: req-d3d6cf65-9b7d-4b6d-b44c-dfad9d547a55) May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:29.634493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:54:29.635969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c2257b6c-717a-43da-9e6e-b2a4ca759e75 could not be found. May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 13:54:29.637186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c2257b6c-717a-43da-9e6e-b2a4ca759e75 could not be found. May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c2257b6c-717a-43da-9e6e-b2a4ca759e75 could not be found. May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-afdb116c-7931-4d59-ac1b-ecadea32bd28 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Returning 404 to user: Snapshot c2257b6c-717a-43da-9e6e-b2a4ca759e75 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:29.639137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-afdb116c-7931-4d59-ac1b-ecadea32bd28 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75" status: 404 len: 111 microversion: 2.1 time: 0.094195 May 19 13:54:29.640787 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 19/38] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 13:54:29 2022] GET /compute/v2.1/os-snapshots/c2257b6c-717a-43da-9e6e-b2a4ca759e75 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:54:29.656652 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-188959c7-8321-4a25-bc43-f6bff4a86ee7 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de395f700>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:29.859343 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d4e0b07e-35b9-4a5a-99df-287db263958b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.860413 May 19 13:54:29.862749 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 20/39] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:54:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:54:29.876872 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bdc60176-1d57-492f-a6e3-ef48e277a5c1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:29.884300 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bdc60176-1d57-492f-a6e3-ef48e277a5c1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:29.914854 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bdc60176-1d57-492f-a6e3-ef48e277a5c1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:29.915392 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bdc60176-1d57-492f-a6e3-ef48e277a5c1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:29.917558 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bdc60176-1d57-492f-a6e3-ef48e277a5c1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:29.917558 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bdc60176-1d57-492f-a6e3-ef48e277a5c1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:29.961171 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-188959c7-8321-4a25-bc43-f6bff4a86ee7 tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b" status: 202 len: 0 microversion: 2.1 time: 0.320465 May 19 13:54:29.961746 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 20/40] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 13:54:29 2022] DELETE /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:54:29.983244 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ad8153f4-e459-47d8-af42-2f433d5af62b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:29.987937 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ad8153f4-e459-47d8-af42-2f433d5af62b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:30.303865 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ad8153f4-e459-47d8-af42-2f433d5af62b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:30.321980 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ad8153f4-e459-47d8-af42-2f433d5af62b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1222 microversion: 2.1 time: 0.348680 May 19 13:54:30.336777 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 21/41] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:29 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1222 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:30.353023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-25dfa52f-37b1-4af2-b4dc-db2fe685f7bc tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de395f0d0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:30.522255 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bdc60176-1d57-492f-a6e3-ef48e277a5c1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:30.583728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bdc60176-1d57-492f-a6e3-ef48e277a5c1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1273 microversion: 2.1 time: 0.716373 May 19 13:54:30.587889 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 21/42] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:29 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1273 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:30.755032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-25dfa52f-37b1-4af2-b4dc-db2fe685f7bc tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] HTTP exception thrown: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-25dfa52f-37b1-4af2-b4dc-db2fe685f7bc tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Request method failure captured: May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b HTTP/1.1 May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwFz7_bgjhyIDBEf0YFqyyI_DYNIljY_o4r8MFpXhREKNE7PmzMjanDlCLWPvma6QCJELrAZWVLlL_9UGYNqJ2XFCwnNxU22rYFoJA8P76XN9SZzbhk-HYSmodVqn4YE0hDVLnH3zlv5UWLnA5z4sBU7pyPoN16iOjlTM7m0jKf0GE May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 4ea632c21d7549c89749672a6f65996d May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:54:30.757355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ea632c21d7549c89749672a6f65996d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ea632c21d7549c89749672a6f65996d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ea632c21d7549c89749672a6f65996d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ea632c21d7549c89749672a6f65996d"}]}] May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 4ea632c21d7549c89749672a6f65996d May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesSnapshotsTestJSON-1253875260-project May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: c3b964fb4e024354ba066b38537d2da9 May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1253875260-project May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b'} May 19 13:54:30.758671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. (HTTP 404) (Request-ID: req-944fa0e3-8ccb-4c87-9ed2-590bd2113b7a) May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:30.759476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:54:30.760604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 13:54:30.762643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.763942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:30.766781 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-25dfa52f-37b1-4af2-b4dc-db2fe685f7bc tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Returning 404 to user: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:30.767308 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-25dfa52f-37b1-4af2-b4dc-db2fe685f7bc tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b" status: 404 len: 109 microversion: 2.1 time: 0.428027 May 19 13:54:30.768986 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 22/43] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 13:54:30 2022] GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b => generated 109 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:54:30.784047 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bf7867f7-e8be-4715-87e0-5baf34c7314c tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de30e4f70>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:30.883304 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-bf7867f7-e8be-4715-87e0-5baf34c7314c tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] HTTP exception thrown: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bf7867f7-e8be-4715-87e0-5baf34c7314c tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Request method failure captured: May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b HTTP/1.1 May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwFz7_bgjhyIDBEf0YFqyyI_DYNIljY_o4r8MFpXhREKNE7PmzMjanDlCLWPvma6QCJELrAZWVLlL_9UGYNqJ2XFCwnNxU22rYFoJA8P76XN9SZzbhk-HYSmodVqn4YE0hDVLnH3zlv5UWLnA5z4sBU7pyPoN16iOjlTM7m0jKf0GE May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 4ea632c21d7549c89749672a6f65996d May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:54:30.885603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ea632c21d7549c89749672a6f65996d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ea632c21d7549c89749672a6f65996d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ea632c21d7549c89749672a6f65996d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ea632c21d7549c89749672a6f65996d"}]}] May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 4ea632c21d7549c89749672a6f65996d May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesSnapshotsTestJSON-1253875260-project May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: c3b964fb4e024354ba066b38537d2da9 May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1253875260-project May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b'} May 19 13:54:30.887299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. (HTTP 404) (Request-ID: req-c9ce1970-9f76-4f08-a954-1b806c3f0cb2) May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:30.888000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 13:54:30.889001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 13:54:30.893591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bf7867f7-e8be-4715-87e0-5baf34c7314c tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Returning 404 to user: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bf7867f7-e8be-4715-87e0-5baf34c7314c tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b" status: 404 len: 109 microversion: 2.1 time: 0.109306 May 19 13:54:30.894994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 22/44] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 13:54:30 2022] DELETE /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:54:30.899677 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c0036bf3-fca7-4b97-a24a-16be11eb0b3d tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Calling method '.version_select at 0x7f5de38da5e0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:30.994089 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-c0036bf3-fca7-4b97-a24a-16be11eb0b3d tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] HTTP exception thrown: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c0036bf3-fca7-4b97-a24a-16be11eb0b3d tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Request method failure captured: May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b HTTP/1.1 May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwFz7_bgjhyIDBEf0YFqyyI_DYNIljY_o4r8MFpXhREKNE7PmzMjanDlCLWPvma6QCJELrAZWVLlL_9UGYNqJ2XFCwnNxU22rYFoJA8P76XN9SZzbhk-HYSmodVqn4YE0hDVLnH3zlv5UWLnA5z4sBU7pyPoN16iOjlTM7m0jKf0GE May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 4ea632c21d7549c89749672a6f65996d May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:54:30.996193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4ea632c21d7549c89749672a6f65996d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ea632c21d7549c89749672a6f65996d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4ea632c21d7549c89749672a6f65996d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4ea632c21d7549c89749672a6f65996d"}]}] May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 4ea632c21d7549c89749672a6f65996d May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1253875260 May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesSnapshotsTestJSON-1253875260-project May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: c3b964fb4e024354ba066b38537d2da9 May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1253875260-project May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b'} May 19 13:54:30.997365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. (HTTP 404) (Request-ID: req-c51057b9-1561-47ae-9638-25c5ebe7bb4c) May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:30.998107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 13:54:30.999198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 13:54:31.000201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. May 19 13:54:31.001192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:54:31.004723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c0036bf3-fca7-4b97-a24a-16be11eb0b3d tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] Returning 404 to user: Volume 3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:54:31.004723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c0036bf3-fca7-4b97-a24a-16be11eb0b3d tempest-VolumesSnapshotsTestJSON-1253875260 tempest-VolumesSnapshotsTestJSON-1253875260-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b" status: 404 len: 109 microversion: 2.1 time: 0.110836 May 19 13:54:31.005665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 23/45] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 13:54:30 2022] GET /compute/v2.1/os-volumes/3bb2d88b-3cd1-4b33-830c-8b2f615b7d0b => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:54:31.359865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e0efbb09-4e91-4f57-ad44-14fbc8359e87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:31.361016 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e0efbb09-4e91-4f57-ad44-14fbc8359e87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:31.376529 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e0efbb09-4e91-4f57-ad44-14fbc8359e87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:31.380324 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e0efbb09-4e91-4f57-ad44-14fbc8359e87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:31.384728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e0efbb09-4e91-4f57-ad44-14fbc8359e87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:31.386422 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e0efbb09-4e91-4f57-ad44-14fbc8359e87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:31.608876 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d1a3cd4b-baeb-4374-b7dc-975db2a46aca tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:31.609607 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d1a3cd4b-baeb-4374-b7dc-975db2a46aca tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:31.623623 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d1a3cd4b-baeb-4374-b7dc-975db2a46aca tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:31.625795 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d1a3cd4b-baeb-4374-b7dc-975db2a46aca tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:31.628465 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d1a3cd4b-baeb-4374-b7dc-975db2a46aca tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:31.629608 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d1a3cd4b-baeb-4374-b7dc-975db2a46aca tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:31.683154 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e0efbb09-4e91-4f57-ad44-14fbc8359e87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:31.704661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e0efbb09-4e91-4f57-ad44-14fbc8359e87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1226 microversion: 2.1 time: 0.353133 May 19 13:54:31.707197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 23/46] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:31 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1226 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:31.930104 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d1a3cd4b-baeb-4374-b7dc-975db2a46aca tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:31.957229 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d1a3cd4b-baeb-4374-b7dc-975db2a46aca tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1273 microversion: 2.1 time: 0.349910 May 19 13:54:31.961496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 24/47] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:31 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1273 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:32.725678 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8a306007-c84d-4d0a-a8d3-77ef0f68c1fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:32.726543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8a306007-c84d-4d0a-a8d3-77ef0f68c1fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:32.760702 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8a306007-c84d-4d0a-a8d3-77ef0f68c1fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:32.763747 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8a306007-c84d-4d0a-a8d3-77ef0f68c1fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:32.765476 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8a306007-c84d-4d0a-a8d3-77ef0f68c1fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:32.768466 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8a306007-c84d-4d0a-a8d3-77ef0f68c1fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:32.999855 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-43e12a6e-8639-41d8-9770-3d9e569772cb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:33.000540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-43e12a6e-8639-41d8-9770-3d9e569772cb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:33.018149 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43e12a6e-8639-41d8-9770-3d9e569772cb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:33.018676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43e12a6e-8639-41d8-9770-3d9e569772cb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:33.023484 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43e12a6e-8639-41d8-9770-3d9e569772cb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:33.023943 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43e12a6e-8639-41d8-9770-3d9e569772cb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:34.034894 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8a306007-c84d-4d0a-a8d3-77ef0f68c1fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:34.053203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8a306007-c84d-4d0a-a8d3-77ef0f68c1fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1282 microversion: 2.1 time: 1.333916 May 19 13:54:34.063611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 24/48] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:32 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1282 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:34.142114 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-43e12a6e-8639-41d8-9770-3d9e569772cb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:34.150114 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-43e12a6e-8639-41d8-9770-3d9e569772cb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1273 microversion: 2.1 time: 1.166486 May 19 13:54:34.158578 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 25/49] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:32 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1273 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:35.072662 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-632db740-040a-4b69-b218-f8bff3f2fcf1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:35.080708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-632db740-040a-4b69-b218-f8bff3f2fcf1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:35.084355 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-632db740-040a-4b69-b218-f8bff3f2fcf1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:35.087877 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-632db740-040a-4b69-b218-f8bff3f2fcf1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:35.089746 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-632db740-040a-4b69-b218-f8bff3f2fcf1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:35.091341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-632db740-040a-4b69-b218-f8bff3f2fcf1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:35.168503 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d6973b9f-5c37-4465-8507-91c8c1a926fd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:35.169490 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d6973b9f-5c37-4465-8507-91c8c1a926fd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:35.180887 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d6973b9f-5c37-4465-8507-91c8c1a926fd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:35.181435 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d6973b9f-5c37-4465-8507-91c8c1a926fd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:35.182128 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d6973b9f-5c37-4465-8507-91c8c1a926fd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:35.182562 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d6973b9f-5c37-4465-8507-91c8c1a926fd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:35.556500 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-632db740-040a-4b69-b218-f8bff3f2fcf1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:35.584562 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-632db740-040a-4b69-b218-f8bff3f2fcf1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1280 microversion: 2.1 time: 0.517284 May 19 13:54:35.585394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 25/50] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:35 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1280 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:35.915021 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d6973b9f-5c37-4465-8507-91c8c1a926fd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:35.942312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d6973b9f-5c37-4465-8507-91c8c1a926fd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1273 microversion: 2.1 time: 0.774329 May 19 13:54:35.952770 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 26/51] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:35 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1273 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:36.602341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0e60c0c6-dc6c-45ba-9000-6b55b8c6e728 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:36.603591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0e60c0c6-dc6c-45ba-9000-6b55b8c6e728 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:36.627628 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0e60c0c6-dc6c-45ba-9000-6b55b8c6e728 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:36.629863 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0e60c0c6-dc6c-45ba-9000-6b55b8c6e728 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:36.631960 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0e60c0c6-dc6c-45ba-9000-6b55b8c6e728 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:36.637519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0e60c0c6-dc6c-45ba-9000-6b55b8c6e728 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:36.960336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-075071d5-fa6e-4eaf-a2e0-b743e7c2ee60 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:36.961603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-075071d5-fa6e-4eaf-a2e0-b743e7c2ee60 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:36.982665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-075071d5-fa6e-4eaf-a2e0-b743e7c2ee60 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:36.987329 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-0e60c0c6-dc6c-45ba-9000-6b55b8c6e728 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:36.997685 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0e60c0c6-dc6c-45ba-9000-6b55b8c6e728 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1280 microversion: 2.1 time: 0.399648 May 19 13:54:36.998587 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-075071d5-fa6e-4eaf-a2e0-b743e7c2ee60 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:37.000394 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-075071d5-fa6e-4eaf-a2e0-b743e7c2ee60 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:37.001347 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 26/52] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:36 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1280 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:37.002587 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-075071d5-fa6e-4eaf-a2e0-b743e7c2ee60 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:37.865700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-075071d5-fa6e-4eaf-a2e0-b743e7c2ee60 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:37.895409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-075071d5-fa6e-4eaf-a2e0-b743e7c2ee60 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.937018 May 19 13:54:37.899704 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 27/53] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:36 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:38.018534 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4f9c75f4-53ba-4fd2-9c0a-cf044f028717 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:38.020248 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4f9c75f4-53ba-4fd2-9c0a-cf044f028717 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:38.034061 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4f9c75f4-53ba-4fd2-9c0a-cf044f028717 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:38.034645 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4f9c75f4-53ba-4fd2-9c0a-cf044f028717 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:38.036259 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4f9c75f4-53ba-4fd2-9c0a-cf044f028717 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:38.038291 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4f9c75f4-53ba-4fd2-9c0a-cf044f028717 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:38.305494 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4f9c75f4-53ba-4fd2-9c0a-cf044f028717 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:38.317561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4f9c75f4-53ba-4fd2-9c0a-cf044f028717 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1280 microversion: 2.1 time: 0.299680 May 19 13:54:38.326206 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 27/54] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:38 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:38.917610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a2d8115e-2bfb-4220-999c-b6f8781f77bd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:38.919780 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a2d8115e-2bfb-4220-999c-b6f8781f77bd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:38.928698 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a2d8115e-2bfb-4220-999c-b6f8781f77bd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:38.931231 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a2d8115e-2bfb-4220-999c-b6f8781f77bd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:38.932925 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a2d8115e-2bfb-4220-999c-b6f8781f77bd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:38.935497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a2d8115e-2bfb-4220-999c-b6f8781f77bd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:39.355949 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-453e6dcd-a42b-454a-8fd1-859a8241eeb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:39.357634 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-453e6dcd-a42b-454a-8fd1-859a8241eeb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:39.390234 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-453e6dcd-a42b-454a-8fd1-859a8241eeb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:39.391594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-453e6dcd-a42b-454a-8fd1-859a8241eeb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:39.392573 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-453e6dcd-a42b-454a-8fd1-859a8241eeb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:39.393156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-453e6dcd-a42b-454a-8fd1-859a8241eeb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:39.472828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=6 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:39.566596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=22 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:39.747860 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a2d8115e-2bfb-4220-999c-b6f8781f77bd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:39.758158 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a2d8115e-2bfb-4220-999c-b6f8781f77bd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.845999 May 19 13:54:39.768924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 28/55] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:38 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:40.142147 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1500924688", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08206db8-8e78-4412-8a62-0db97bb617cf"}], "security_groups": [{"name": "tempest-securitygroup--640803697"}], "key_name": "tempest-keypair-400520829", "user_data": "}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:40.183182 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-453e6dcd-a42b-454a-8fd1-859a8241eeb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:40.198886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-453e6dcd-a42b-454a-8fd1-859a8241eeb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.847386 May 19 13:54:40.200464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 28/56] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:39 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:40.341002 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=12 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:40.786374 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a60a7169-d22d-49cd-a213-0bf9181f4f50 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:40.787155 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a60a7169-d22d-49cd-a213-0bf9181f4f50 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:40.798703 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a60a7169-d22d-49cd-a213-0bf9181f4f50 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:40.801347 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a60a7169-d22d-49cd-a213-0bf9181f4f50 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:40.811611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a60a7169-d22d-49cd-a213-0bf9181f4f50 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:40.814781 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a60a7169-d22d-49cd-a213-0bf9181f4f50 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:41.187845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] validate_networks() for [('08206db8-8e78-4412-8a62-0db97bb617cf', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:54:41.829999 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a60a7169-d22d-49cd-a213-0bf9181f4f50 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:41.844194 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a60a7169-d22d-49cd-a213-0bf9181f4f50 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 1.062269 May 19 13:54:41.856763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 29/57] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:40 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:41.869208 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1f27f9bd-306a-4996-9ce6-2ec54bcccdf2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:41.870189 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1f27f9bd-306a-4996-9ce6-2ec54bcccdf2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:41.880150 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bd-306a-4996-9ce6-2ec54bcccdf2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:41.881099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bd-306a-4996-9ce6-2ec54bcccdf2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:41.882715 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bd-306a-4996-9ce6-2ec54bcccdf2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:41.885073 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f27f9bd-306a-4996-9ce6-2ec54bcccdf2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:43.198194 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1f27f9bd-306a-4996-9ce6-2ec54bcccdf2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:43.215416 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=59 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:43.226996 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1f27f9bd-306a-4996-9ce6-2ec54bcccdf2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 1.359970 May 19 13:54:43.228577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 30/58] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:41 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:43.238919 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-764450094", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad76f5bc-7148-40ee-8a08-ce1742f9a049"}], "security_groups": [{"name": "tempest-securitygroup--556661666"}], "key_name": "tempest-keypair-1285268638", "user_data": "}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:43.255845 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=9 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:44.186717 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] validate_networks() for [('ad76f5bc-7148-40ee-8a08-ce1742f9a049', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:54:45.479575 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:54:45.480146 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:54:45.481423 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:54:45.481838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:54:45.482254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:54:45.486998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:45.495561 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:45.496621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:45.497779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:45.498452 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:45.520059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=67 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:45.533969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for project 89b4336043d5446b922432a2f43af17a. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:54:45.539619 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for user 0cc3e0105f2a472092423852b1f39979 and project 89b4336043d5446b922432a2f43af17a. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:54:45.555918 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:54:45.560391 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:54:45.659360 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-993b2dd7-792f-492b-a113-5a770ef46322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.522678 May 19 13:54:45.663492 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 29/59] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:54:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 5529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 13:54:45.677503 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-178ce1f8-4874-4f69-8244-416fe30cb9b4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:45.679764 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-178ce1f8-4874-4f69-8244-416fe30cb9b4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:45.703227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-178ce1f8-4874-4f69-8244-416fe30cb9b4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:45.706239 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-178ce1f8-4874-4f69-8244-416fe30cb9b4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:45.707291 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-178ce1f8-4874-4f69-8244-416fe30cb9b4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:45.707960 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-178ce1f8-4874-4f69-8244-416fe30cb9b4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:45.733165 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:54:45.733784 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:54:45.734027 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:54:45.734429 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:54:45.734834 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:54:45.749122 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:45.749569 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:45.750356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:45.750788 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:45.804065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Getting quotas for project 4eed7a893f7b42edaadbf898ebe16cd6. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:54:45.809607 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Getting quotas for user 00b21c3634cc41aca680152740644168 and project 4eed7a893f7b42edaadbf898ebe16cd6. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:54:45.830410 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:54:45.832599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:54:45.905196 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1fcd528a-db60-4567-b69d-83f9c65cb4ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.675369 May 19 13:54:45.906348 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 31/60] 10.222.0.52 () {62 vars in 1187 bytes} [Thu May 19 13:54:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 2677 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 13:54:45.972714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-178ce1f8-4874-4f69-8244-416fe30cb9b4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:45.989698 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-178ce1f8-4874-4f69-8244-416fe30cb9b4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.324696 May 19 13:54:45.990289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 30/61] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:45 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:46.002614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-24ddb0ff-b2ac-4212-9e3a-9aa372485183 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:46.003634 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-24ddb0ff-b2ac-4212-9e3a-9aa372485183 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:46.013095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-24ddb0ff-b2ac-4212-9e3a-9aa372485183 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:46.013826 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-24ddb0ff-b2ac-4212-9e3a-9aa372485183 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:46.014791 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-24ddb0ff-b2ac-4212-9e3a-9aa372485183 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:46.015392 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-24ddb0ff-b2ac-4212-9e3a-9aa372485183 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:46.144669 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-69f52a65-ade4-41a4-9517-ff0b75968f12 req-39b2ee2a-b3cd-44a7-a43d-732812e58676 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaac7a1c-80e3-46ab-a5a0-2135ac395d2f", "tag": "9c788124-2671-444c-98f8-1098c854377e"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:46.164258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-69f52a65-ade4-41a4-9517-ff0b75968f12 req-39b2ee2a-b3cd-44a7-a43d-732812e58676 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:46.165661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-69f52a65-ade4-41a4-9517-ff0b75968f12 req-39b2ee2a-b3cd-44a7-a43d-732812e58676 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:46.193090 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-69f52a65-ade4-41a4-9517-ff0b75968f12 req-39b2ee2a-b3cd-44a7-a43d-732812e58676 service nova] Creating event network-changed:9c788124-2671-444c-98f8-1098c854377e for instance aaac7a1c-80e3-46ab-a5a0-2135ac395d2f on hv-cinder-78481 May 19 13:54:46.194386 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-69f52a65-ade4-41a4-9517-ff0b75968f12 req-39b2ee2a-b3cd-44a7-a43d-732812e58676 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123751) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 13:54:46.196002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ce328c4e-037b-4e89-8bc0-cc6159978cb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:46.196649 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ce328c4e-037b-4e89-8bc0-cc6159978cb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:46.197654 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ce328c4e-037b-4e89-8bc0-cc6159978cb1 None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:46.198434 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ce328c4e-037b-4e89-8bc0-cc6159978cb1 None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:46.210977 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.compute.rpcapi [None req-ce328c4e-037b-4e89-8bc0-cc6159978cb1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 13:54:46.212119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ce328c4e-037b-4e89-8bc0-cc6159978cb1 None None] Releasing lock "compute-rpcapi-router" {{(pid=123751) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 13:54:46.254369 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ce328c4e-037b-4e89-8bc0-cc6159978cb1 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.346499 May 19 13:54:46.255283 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 32/62] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:46.324866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-24ddb0ff-b2ac-4212-9e3a-9aa372485183 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:46.335907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-24ddb0ff-b2ac-4212-9e3a-9aa372485183 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.343550 May 19 13:54:46.337582 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 31/63] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:45 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:46.343674 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5b4b4b93-61c5-4d5d-819c-37c68c26f9b9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:46.344642 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5b4b4b93-61c5-4d5d-819c-37c68c26f9b9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:46.385408 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-c1b0fef2-5745-4ce4-9d5a-25c73d25868e req-f4960240-46ed-488b-9198-bcee05e6a149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0a5331-be2a-4c5b-80ac-6be7220f2516", "tag": "1c2ca481-d8b3-43c5-9df6-5b028371dcf0"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:46.407614 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-c1b0fef2-5745-4ce4-9d5a-25c73d25868e req-f4960240-46ed-488b-9198-bcee05e6a149 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:46.408058 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-c1b0fef2-5745-4ce4-9d5a-25c73d25868e req-f4960240-46ed-488b-9198-bcee05e6a149 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:46.421117 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5b4b4b93-61c5-4d5d-819c-37c68c26f9b9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:46.427791 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-c1b0fef2-5745-4ce4-9d5a-25c73d25868e req-f4960240-46ed-488b-9198-bcee05e6a149 service nova] Creating event network-changed:1c2ca481-d8b3-43c5-9df6-5b028371dcf0 for instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 on hv-cinder-78481 May 19 13:54:46.433992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-c1b0fef2-5745-4ce4-9d5a-25c73d25868e req-f4960240-46ed-488b-9198-bcee05e6a149 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176092 May 19 13:54:46.435109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 33/64] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:46.446332 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-57f512de-bded-4386-b3c7-ff5d46c360d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:46.447082 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-57f512de-bded-4386-b3c7-ff5d46c360d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:46.471764 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5b4b4b93-61c5-4d5d-819c-37c68c26f9b9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1241 microversion: 2.1 time: 0.130760 May 19 13:54:46.472376 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 32/65] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:46 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:46.533136 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-57f512de-bded-4386-b3c7-ff5d46c360d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:46.542243 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-57f512de-bded-4386-b3c7-ff5d46c360d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:46.545224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-57f512de-bded-4386-b3c7-ff5d46c360d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:46.546618 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-57f512de-bded-4386-b3c7-ff5d46c360d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1281 microversion: 2.20 time: 0.109650 May 19 13:54:46.547681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:46 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:54:47.010329 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8075b2f1-6502-43b2-a040-a8c45eec8260 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:47.011024 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8075b2f1-6502-43b2-a040-a8c45eec8260 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:47.018765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8075b2f1-6502-43b2-a040-a8c45eec8260 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:47.019222 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8075b2f1-6502-43b2-a040-a8c45eec8260 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:47.025522 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8075b2f1-6502-43b2-a040-a8c45eec8260 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:47.026528 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8075b2f1-6502-43b2-a040-a8c45eec8260 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:47.353415 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8347d105-1d67-4ade-8373-22db209cedfe tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:47.354098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8347d105-1d67-4ade-8373-22db209cedfe tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:47.361257 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8347d105-1d67-4ade-8373-22db209cedfe tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:47.361696 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8347d105-1d67-4ade-8373-22db209cedfe tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:47.362461 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8347d105-1d67-4ade-8373-22db209cedfe tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:47.362910 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8347d105-1d67-4ade-8373-22db209cedfe tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:47.465634 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8075b2f1-6502-43b2-a040-a8c45eec8260 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:47.475001 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8075b2f1-6502-43b2-a040-a8c45eec8260 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.469409 May 19 13:54:47.475580 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 33/67] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:47 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:47.489272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-35332e48-cd22-4d7b-84fe-435d96e3c414 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:47.489878 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-35332e48-cd22-4d7b-84fe-435d96e3c414 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:47.497152 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35332e48-cd22-4d7b-84fe-435d96e3c414 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:47.497500 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35332e48-cd22-4d7b-84fe-435d96e3c414 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:47.498339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35332e48-cd22-4d7b-84fe-435d96e3c414 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:47.498738 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35332e48-cd22-4d7b-84fe-435d96e3c414 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:47.552128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8347d105-1d67-4ade-8373-22db209cedfe tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:47.563965 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8347d105-1d67-4ade-8373-22db209cedfe tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.213834 May 19 13:54:47.564850 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 35/68] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:47 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:47.570258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:47.571071 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:47.578495 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:47.579084 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-35332e48-cd22-4d7b-84fe-435d96e3c414 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:47.579292 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:47.580219 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:47.580709 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:47.586942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-35332e48-cd22-4d7b-84fe-435d96e3c414 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.101221 May 19 13:54:47.588117 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 34/69] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:47 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:47.607179 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1597927250", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "networks": [{"uuid": "8ff3cec5-cb61-42f1-9f06-2f870efcc775"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:47.649406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:47.659916 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:47.661430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:47.662348 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] validate_networks() for [('8ff3cec5-cb61-42f1-9f06-2f870efcc775', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:54:47.662532 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c780ad44-847b-4a47-baec-03aedf11a6d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1333 microversion: 2.20 time: 0.096258 May 19 13:54:47.663297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:47 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:54:48.098994 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:54:48.099467 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:54:48.099870 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:54:48.100272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:54:48.100680 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:54:48.115148 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.115590 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.117299 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.117870 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.140861 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Getting quotas for project 4fe46ffac52d412daf3663e2ab1273de. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:54:48.146354 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Getting quotas for user a9a3080f9aef4323952eed19ef9bb074 and project 4fe46ffac52d412daf3663e2ab1273de. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:54:48.161763 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:54:48.164336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:54:48.226420 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-952e200c-b9ad-4441-8572-45ac85642236 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622849 May 19 13:54:48.227700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 35/71] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:54:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 13:54:48.240306 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ded336a3-5db0-4127-9e83-888136f13cb8 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:48.241106 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ded336a3-5db0-4127-9e83-888136f13cb8 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:48.328745 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ded336a3-5db0-4127-9e83-888136f13cb8 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:48.338250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ded336a3-5db0-4127-9e83-888136f13cb8 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1214 microversion: 2.1 time: 0.104050 May 19 13:54:48.341451 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 37/72] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:48 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:48.457285 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-902407c6-e76a-42b2-8ada-eb9e7a1a8f80 req-983f197b-b93c-43fa-a096-2b278838b535 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d532aab-b9b2-43ad-8536-36ac47c34097", "tag": "b7ff7282-c5a8-4eda-8af0-d48c8e33d4ad"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:54:48.470855 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-902407c6-e76a-42b2-8ada-eb9e7a1a8f80 req-983f197b-b93c-43fa-a096-2b278838b535 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.471363 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-902407c6-e76a-42b2-8ada-eb9e7a1a8f80 req-983f197b-b93c-43fa-a096-2b278838b535 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.491161 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-05ed1633-715d-43b6-9d71-d25d14652de6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:48.491697 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-902407c6-e76a-42b2-8ada-eb9e7a1a8f80 req-983f197b-b93c-43fa-a096-2b278838b535 service nova] Creating event network-changed:b7ff7282-c5a8-4eda-8af0-d48c8e33d4ad for instance 2d532aab-b9b2-43ad-8536-36ac47c34097 on hv-cinder-78481 May 19 13:54:48.491897 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-902407c6-e76a-42b2-8ada-eb9e7a1a8f80 req-983f197b-b93c-43fa-a096-2b278838b535 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123752) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 13:54:48.492446 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-05ed1633-715d-43b6-9d71-d25d14652de6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:48.492977 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6b27a966-9777-4727-b46b-b632aa4cadb3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.493417 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6b27a966-9777-4727-b46b-b632aa4cadb3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.494201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6b27a966-9777-4727-b46b-b632aa4cadb3 None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.494631 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6b27a966-9777-4727-b46b-b632aa4cadb3 None None] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.499763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-05ed1633-715d-43b6-9d71-d25d14652de6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.500533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-05ed1633-715d-43b6-9d71-d25d14652de6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.501453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-05ed1633-715d-43b6-9d71-d25d14652de6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.501885 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-05ed1633-715d-43b6-9d71-d25d14652de6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.504287 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.compute.rpcapi [None req-6b27a966-9777-4727-b46b-b632aa4cadb3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 13:54:48.505166 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6b27a966-9777-4727-b46b-b632aa4cadb3 None None] Releasing lock "compute-rpcapi-router" {{(pid=123752) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 13:54:48.520788 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6b27a966-9777-4727-b46b-b632aa4cadb3 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067095 May 19 13:54:48.521451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 36/73] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:54:48.582177 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-44243f55-7460-42b5-9659-66d3d3410e81 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:48.582875 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-44243f55-7460-42b5-9659-66d3d3410e81 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:48.592778 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44243f55-7460-42b5-9659-66d3d3410e81 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.593887 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44243f55-7460-42b5-9659-66d3d3410e81 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.595659 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44243f55-7460-42b5-9659-66d3d3410e81 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.596118 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44243f55-7460-42b5-9659-66d3d3410e81 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.662290 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-05ed1633-715d-43b6-9d71-d25d14652de6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:48.672608 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-05ed1633-715d-43b6-9d71-d25d14652de6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.185185 May 19 13:54:48.680067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 38/74] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:48 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:48.687406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d13dbf09-470b-4eac-99ce-8c2d1d254a16 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:48.688066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d13dbf09-470b-4eac-99ce-8c2d1d254a16 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:48.694956 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d13dbf09-470b-4eac-99ce-8c2d1d254a16 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.695356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d13dbf09-470b-4eac-99ce-8c2d1d254a16 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.696128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d13dbf09-470b-4eac-99ce-8c2d1d254a16 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.696560 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d13dbf09-470b-4eac-99ce-8c2d1d254a16 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.769052 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d13dbf09-470b-4eac-99ce-8c2d1d254a16 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:48.776365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d13dbf09-470b-4eac-99ce-8c2d1d254a16 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.095276 May 19 13:54:48.776990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 39/75] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:48 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:48.781638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:48.782241 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:48.784768 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-44243f55-7460-42b5-9659-66d3d3410e81 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:48.788462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.788904 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.789657 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:48.790083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:48.793131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-44243f55-7460-42b5-9659-66d3d3410e81 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.215265 May 19 13:54:48.793798 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 37/76] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:48 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:48.852933 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:48.861430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:48.862882 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:48.863974 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-090d87f9-a4a6-49e6-a9f1-c2c8df97bb3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1333 microversion: 2.20 time: 0.085897 May 19 13:54:48.864517 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 40/77] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:48 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:54:49.357811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d6bd3b57-125d-46ef-bdd6-8da9d99ae148 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:49.358444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d6bd3b57-125d-46ef-bdd6-8da9d99ae148 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:49.364920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d6bd3b57-125d-46ef-bdd6-8da9d99ae148 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.365364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d6bd3b57-125d-46ef-bdd6-8da9d99ae148 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.366126 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d6bd3b57-125d-46ef-bdd6-8da9d99ae148 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.366555 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d6bd3b57-125d-46ef-bdd6-8da9d99ae148 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.430657 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d6bd3b57-125d-46ef-bdd6-8da9d99ae148 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:49.438551 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d6bd3b57-125d-46ef-bdd6-8da9d99ae148 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.084782 May 19 13:54:49.439161 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 38/78] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:49 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:49.689369 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9b23c1fe-6d53-43ba-8c31-ca031558ce70 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:49.690002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9b23c1fe-6d53-43ba-8c31-ca031558ce70 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:49.696064 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b23c1fe-6d53-43ba-8c31-ca031558ce70 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.696503 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b23c1fe-6d53-43ba-8c31-ca031558ce70 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.697250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b23c1fe-6d53-43ba-8c31-ca031558ce70 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.697679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b23c1fe-6d53-43ba-8c31-ca031558ce70 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.794498 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-70663a81-032a-42f1-943e-94df1510ecb8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:49.795151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-70663a81-032a-42f1-943e-94df1510ecb8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:49.802741 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-70663a81-032a-42f1-943e-94df1510ecb8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.803222 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-70663a81-032a-42f1-943e-94df1510ecb8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.804168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-70663a81-032a-42f1-943e-94df1510ecb8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.804763 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-70663a81-032a-42f1-943e-94df1510ecb8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.839744 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9b23c1fe-6d53-43ba-8c31-ca031558ce70 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:49.847519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9b23c1fe-6d53-43ba-8c31-ca031558ce70 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.161874 May 19 13:54:49.848090 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 41/79] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:49 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:49.852472 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d94452ac-f44e-44d8-b91e-fa4e454d7123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:49.853258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d94452ac-f44e-44d8-b91e-fa4e454d7123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:49.859444 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d94452ac-f44e-44d8-b91e-fa4e454d7123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.859895 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d94452ac-f44e-44d8-b91e-fa4e454d7123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.860660 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d94452ac-f44e-44d8-b91e-fa4e454d7123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.861099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d94452ac-f44e-44d8-b91e-fa4e454d7123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.872654 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-70663a81-032a-42f1-943e-94df1510ecb8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:49.881385 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-70663a81-032a-42f1-943e-94df1510ecb8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.091785 May 19 13:54:49.881952 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 39/80] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:49 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:49.890170 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:49.890980 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:49.897369 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.897810 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.898570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:49.899040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:49.972951 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:49.981745 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:49.983250 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:49.984338 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8a9b160e-dc77-4534-a824-7856a8b76d07 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1333 microversion: 2.20 time: 0.101179 May 19 13:54:49.984880 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 40/81] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:49 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:54:50.015119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d94452ac-f44e-44d8-b91e-fa4e454d7123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:50.022491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d94452ac-f44e-44d8-b91e-fa4e454d7123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.173438 May 19 13:54:50.023080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 42/82] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:49 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:50.455683 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6e4d7747-e2d4-4a1a-9b79-5ffe1491a583 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:50.456285 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6e4d7747-e2d4-4a1a-9b79-5ffe1491a583 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:50.462251 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6e4d7747-e2d4-4a1a-9b79-5ffe1491a583 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:50.462715 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6e4d7747-e2d4-4a1a-9b79-5ffe1491a583 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:50.463494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6e4d7747-e2d4-4a1a-9b79-5ffe1491a583 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:50.463931 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6e4d7747-e2d4-4a1a-9b79-5ffe1491a583 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:50.523246 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6e4d7747-e2d4-4a1a-9b79-5ffe1491a583 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:50.530709 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6e4d7747-e2d4-4a1a-9b79-5ffe1491a583 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.078838 May 19 13:54:50.531292 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 41/83] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:50 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:50.864431 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e6045ade-5716-4606-9630-570851ea59dc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:50.865033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e6045ade-5716-4606-9630-570851ea59dc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:50.871868 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e6045ade-5716-4606-9630-570851ea59dc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:50.872317 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e6045ade-5716-4606-9630-570851ea59dc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:50.873076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e6045ade-5716-4606-9630-570851ea59dc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:50.873531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e6045ade-5716-4606-9630-570851ea59dc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:50.898823 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5431224d-c977-41a7-8235-82d1c8d53bab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:50.899461 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5431224d-c977-41a7-8235-82d1c8d53bab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:50.905609 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5431224d-c977-41a7-8235-82d1c8d53bab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:50.906057 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5431224d-c977-41a7-8235-82d1c8d53bab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:50.906822 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5431224d-c977-41a7-8235-82d1c8d53bab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:50.907308 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5431224d-c977-41a7-8235-82d1c8d53bab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:50.983471 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5431224d-c977-41a7-8235-82d1c8d53bab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:50.990799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5431224d-c977-41a7-8235-82d1c8d53bab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.095778 May 19 13:54:50.991396 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 42/84] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:50 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:51.002465 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:51.003444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:51.009442 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:51.009896 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:51.010655 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:51.011118 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:51.024032 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e6045ade-5716-4606-9630-570851ea59dc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:51.031638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e6045ade-5716-4606-9630-570851ea59dc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.171075 May 19 13:54:51.032302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 43/85] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:50 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:51.039165 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c496c5ff-ad45-4db1-a708-c09d9aeb2765 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:51.039886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c496c5ff-ad45-4db1-a708-c09d9aeb2765 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:51.047156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c496c5ff-ad45-4db1-a708-c09d9aeb2765 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:51.047608 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c496c5ff-ad45-4db1-a708-c09d9aeb2765 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:51.048367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c496c5ff-ad45-4db1-a708-c09d9aeb2765 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:51.048797 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c496c5ff-ad45-4db1-a708-c09d9aeb2765 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:51.102359 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:51.112106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:51.113995 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:51.115281 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cfe5bb6c-3055-4e63-8ab4-77aa3b096890 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1333 microversion: 2.20 time: 0.116444 May 19 13:54:51.116066 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 43/86] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:50 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:54:51.227184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c496c5ff-ad45-4db1-a708-c09d9aeb2765 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:51.235221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c496c5ff-ad45-4db1-a708-c09d9aeb2765 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.199397 May 19 13:54:51.235924 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 44/87] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:51 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:51.547023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d4228ffd-92af-4081-975d-8c2a67dd3dd2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:51.548209 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d4228ffd-92af-4081-975d-8c2a67dd3dd2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:51.555307 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4228ffd-92af-4081-975d-8c2a67dd3dd2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:51.556066 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4228ffd-92af-4081-975d-8c2a67dd3dd2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:51.556969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4228ffd-92af-4081-975d-8c2a67dd3dd2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:51.557536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4228ffd-92af-4081-975d-8c2a67dd3dd2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:51.632747 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d4228ffd-92af-4081-975d-8c2a67dd3dd2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:51.641260 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d4228ffd-92af-4081-975d-8c2a67dd3dd2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.098431 May 19 13:54:51.641824 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 44/88] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:51 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:52.007875 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a41a4302-0ea5-4b54-9ddb-9356a8cbc594 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:52.008475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a41a4302-0ea5-4b54-9ddb-9356a8cbc594 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:52.014580 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a41a4302-0ea5-4b54-9ddb-9356a8cbc594 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.015048 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a41a4302-0ea5-4b54-9ddb-9356a8cbc594 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.015885 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a41a4302-0ea5-4b54-9ddb-9356a8cbc594 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.016341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a41a4302-0ea5-4b54-9ddb-9356a8cbc594 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.049346 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-060b731e-f842-4d0c-9eb6-b265f0ce7c4f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:52.050663 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-060b731e-f842-4d0c-9eb6-b265f0ce7c4f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:52.058374 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-060b731e-f842-4d0c-9eb6-b265f0ce7c4f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.058933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-060b731e-f842-4d0c-9eb6-b265f0ce7c4f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.059795 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-060b731e-f842-4d0c-9eb6-b265f0ce7c4f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.060616 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-060b731e-f842-4d0c-9eb6-b265f0ce7c4f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.088623 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a41a4302-0ea5-4b54-9ddb-9356a8cbc594 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:52.101334 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a41a4302-0ea5-4b54-9ddb-9356a8cbc594 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.096964 May 19 13:54:52.111460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 45/89] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:52 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:52.138561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:52.139214 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:52.147423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.148310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.149325 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.150461 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.211977 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-060b731e-f842-4d0c-9eb6-b265f0ce7c4f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:52.227415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-060b731e-f842-4d0c-9eb6-b265f0ce7c4f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.182185 May 19 13:54:52.228177 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 45/90] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:52 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:52.242742 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:52.253033 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8a7a24b8-98de-46f1-b30d-f2b6d58a04e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:52.254999 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8a7a24b8-98de-46f1-b30d-f2b6d58a04e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:52.256852 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:52.258578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:52.263072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a7a24b8-98de-46f1-b30d-f2b6d58a04e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.263599 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a7a24b8-98de-46f1-b30d-f2b6d58a04e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.264582 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ec958aeb-a197-442c-9fca-6c3c70abd57d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1341 microversion: 2.20 time: 0.132882 May 19 13:54:52.264705 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a7a24b8-98de-46f1-b30d-f2b6d58a04e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.265312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a7a24b8-98de-46f1-b30d-f2b6d58a04e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.265442 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 46/91] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:52 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1341 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:54:52.393470 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8a7a24b8-98de-46f1-b30d-f2b6d58a04e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:52.401092 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8a7a24b8-98de-46f1-b30d-f2b6d58a04e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.152156 May 19 13:54:52.401644 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 46/92] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:52 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:52.658664 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-555ba546-0c2f-4041-8f57-8fe1fe71633c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:52.659242 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-555ba546-0c2f-4041-8f57-8fe1fe71633c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:52.665197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-555ba546-0c2f-4041-8f57-8fe1fe71633c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.665641 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-555ba546-0c2f-4041-8f57-8fe1fe71633c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.666390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-555ba546-0c2f-4041-8f57-8fe1fe71633c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:52.666822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-555ba546-0c2f-4041-8f57-8fe1fe71633c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:52.728451 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-555ba546-0c2f-4041-8f57-8fe1fe71633c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:52.743145 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-555ba546-0c2f-4041-8f57-8fe1fe71633c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.081289 May 19 13:54:52.743739 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 47/93] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:52 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:53.121499 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ebe26d05-8381-406c-a741-7dab753e449b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:53.122138 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ebe26d05-8381-406c-a741-7dab753e449b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:53.128376 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ebe26d05-8381-406c-a741-7dab753e449b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.128819 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ebe26d05-8381-406c-a741-7dab753e449b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.129565 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ebe26d05-8381-406c-a741-7dab753e449b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.129987 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ebe26d05-8381-406c-a741-7dab753e449b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.189511 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ebe26d05-8381-406c-a741-7dab753e449b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:53.198251 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ebe26d05-8381-406c-a741-7dab753e449b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.081506 May 19 13:54:53.198981 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 47/94] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:53 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:53.245065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c5ea39c6-e5dd-4d63-93db-5294ebc02ac1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:53.246289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c5ea39c6-e5dd-4d63-93db-5294ebc02ac1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:53.252478 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5ea39c6-e5dd-4d63-93db-5294ebc02ac1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.252927 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5ea39c6-e5dd-4d63-93db-5294ebc02ac1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.253937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5ea39c6-e5dd-4d63-93db-5294ebc02ac1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.254375 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5ea39c6-e5dd-4d63-93db-5294ebc02ac1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.282035 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:53.282641 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:53.289311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.289882 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.290502 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.290952 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.310159 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=100 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:53.370372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:53.379504 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:53.381033 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:53.382136 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c74b267d-de53-4fe7-b5cb-6a3199df7bd6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1341 microversion: 2.20 time: 0.103993 May 19 13:54:53.382686 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 48/95] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:53 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1341 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:54:53.407978 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c5ea39c6-e5dd-4d63-93db-5294ebc02ac1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:53.415560 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c5ea39c6-e5dd-4d63-93db-5294ebc02ac1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.174293 May 19 13:54:53.416134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 48/96] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:53 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:53.417338 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ece4af84-70e7-43e6-89e6-733bb5f71600 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:53.418623 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ece4af84-70e7-43e6-89e6-733bb5f71600 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:53.424685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ece4af84-70e7-43e6-89e6-733bb5f71600 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.425133 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ece4af84-70e7-43e6-89e6-733bb5f71600 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.425890 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ece4af84-70e7-43e6-89e6-733bb5f71600 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.426326 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ece4af84-70e7-43e6-89e6-733bb5f71600 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.556202 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ece4af84-70e7-43e6-89e6-733bb5f71600 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:53.563769 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ece4af84-70e7-43e6-89e6-733bb5f71600 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.150224 May 19 13:54:53.564331 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 49/97] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:53 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:53.761187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2906d5ab-e45a-4f4b-998e-ac348ec87d01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:53.762069 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2906d5ab-e45a-4f4b-998e-ac348ec87d01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:53.771092 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2906d5ab-e45a-4f4b-998e-ac348ec87d01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.771770 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2906d5ab-e45a-4f4b-998e-ac348ec87d01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.772931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2906d5ab-e45a-4f4b-998e-ac348ec87d01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:53.773598 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2906d5ab-e45a-4f4b-998e-ac348ec87d01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:53.840179 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2906d5ab-e45a-4f4b-998e-ac348ec87d01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:53.848545 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2906d5ab-e45a-4f4b-998e-ac348ec87d01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.091316 May 19 13:54:53.849109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 49/98] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:53 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:54.215536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-79992560-c5eb-4d6d-9ab1-8a3170f3edb2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:54.216152 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-79992560-c5eb-4d6d-9ab1-8a3170f3edb2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:54.222057 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-79992560-c5eb-4d6d-9ab1-8a3170f3edb2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.222500 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-79992560-c5eb-4d6d-9ab1-8a3170f3edb2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.223296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-79992560-c5eb-4d6d-9ab1-8a3170f3edb2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.223724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-79992560-c5eb-4d6d-9ab1-8a3170f3edb2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.283679 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-79992560-c5eb-4d6d-9ab1-8a3170f3edb2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:54.291040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-79992560-c5eb-4d6d-9ab1-8a3170f3edb2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.080008 May 19 13:54:54.291597 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 50/99] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:54 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:54.399504 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:54.400132 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:54.407297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.407746 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.408518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.408949 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.432377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-efcfe444-68ac-42ef-a201-8b5cf300be14 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:54.432984 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-efcfe444-68ac-42ef-a201-8b5cf300be14 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:54.439412 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-efcfe444-68ac-42ef-a201-8b5cf300be14 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.439893 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-efcfe444-68ac-42ef-a201-8b5cf300be14 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.440679 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-efcfe444-68ac-42ef-a201-8b5cf300be14 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.441115 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-efcfe444-68ac-42ef-a201-8b5cf300be14 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.474500 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:54.483320 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:54.484841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:54.485941 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5dd68f72-7126-47d7-8a86-ba046ca04c29 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1341 microversion: 2.20 time: 0.090285 May 19 13:54:54.486496 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 50/100] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:54 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1341 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:54:54.569693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-efcfe444-68ac-42ef-a201-8b5cf300be14 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:54.578054 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-efcfe444-68ac-42ef-a201-8b5cf300be14 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.149407 May 19 13:54:54.578624 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 51/101] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:54 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:54.580851 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9b9b1c2a-803d-4a9f-95a8-7510d52e6f8f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:54.581501 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9b9b1c2a-803d-4a9f-95a8-7510d52e6f8f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:54.587439 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b9b1c2a-803d-4a9f-95a8-7510d52e6f8f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.587880 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b9b1c2a-803d-4a9f-95a8-7510d52e6f8f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.588625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b9b1c2a-803d-4a9f-95a8-7510d52e6f8f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.589063 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b9b1c2a-803d-4a9f-95a8-7510d52e6f8f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.592416 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:54.716633 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9b9b1c2a-803d-4a9f-95a8-7510d52e6f8f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:54.724005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9b9b1c2a-803d-4a9f-95a8-7510d52e6f8f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.146845 May 19 13:54:54.724496 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 51/102] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:54 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:54.864647 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f273eb41-cc23-423a-868c-fa66a55b0895 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:54.865257 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f273eb41-cc23-423a-868c-fa66a55b0895 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:54.871990 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f273eb41-cc23-423a-868c-fa66a55b0895 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.872440 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f273eb41-cc23-423a-868c-fa66a55b0895 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.873199 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f273eb41-cc23-423a-868c-fa66a55b0895 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:54.873631 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f273eb41-cc23-423a-868c-fa66a55b0895 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:54.935412 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f273eb41-cc23-423a-868c-fa66a55b0895 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:54.942704 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f273eb41-cc23-423a-868c-fa66a55b0895 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.081842 May 19 13:54:54.943300 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 52/103] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:54 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:55.307903 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-345f452a-d93f-4978-a05c-4fd0132244a4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:55.308621 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-345f452a-d93f-4978-a05c-4fd0132244a4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:55.314572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-345f452a-d93f-4978-a05c-4fd0132244a4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.315044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-345f452a-d93f-4978-a05c-4fd0132244a4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:55.315790 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-345f452a-d93f-4978-a05c-4fd0132244a4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.316223 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-345f452a-d93f-4978-a05c-4fd0132244a4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:55.376318 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-345f452a-d93f-4978-a05c-4fd0132244a4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:55.383803 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-345f452a-d93f-4978-a05c-4fd0132244a4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.079823 May 19 13:54:55.384365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 52/104] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:55 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:55.504578 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:55.505191 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:55.511775 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.512270 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:55.513037 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.513468 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:55.573985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:55.581907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:55.583473 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:55.584572 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0e64e65b-82bc-47ab-b52c-5603dafe1762 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1341 microversion: 2.20 time: 0.084108 May 19 13:54:55.585165 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 53/105] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:55 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1341 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:54:55.593767 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-deef3de4-299c-4f2e-939f-0e74089c966e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:55.594445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-deef3de4-299c-4f2e-939f-0e74089c966e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:55.600464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-deef3de4-299c-4f2e-939f-0e74089c966e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.600910 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-deef3de4-299c-4f2e-939f-0e74089c966e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:55.601667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-deef3de4-299c-4f2e-939f-0e74089c966e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.602102 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-deef3de4-299c-4f2e-939f-0e74089c966e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:55.728838 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-deef3de4-299c-4f2e-939f-0e74089c966e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:55.736317 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-deef3de4-299c-4f2e-939f-0e74089c966e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.146357 May 19 13:54:55.736874 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 53/106] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:55 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:55.740290 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ffd5fed1-325a-4f48-828d-04a20efd98c8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:55.740897 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ffd5fed1-325a-4f48-828d-04a20efd98c8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:55.747401 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffd5fed1-325a-4f48-828d-04a20efd98c8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.747841 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffd5fed1-325a-4f48-828d-04a20efd98c8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:55.748586 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffd5fed1-325a-4f48-828d-04a20efd98c8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.749017 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffd5fed1-325a-4f48-828d-04a20efd98c8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:55.878414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ffd5fed1-325a-4f48-828d-04a20efd98c8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:55.885838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ffd5fed1-325a-4f48-828d-04a20efd98c8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.149331 May 19 13:54:55.887052 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 54/107] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:55 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:55.958999 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-61f2edb7-8375-4bd3-88d0-c56520447023 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:55.959613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-61f2edb7-8375-4bd3-88d0-c56520447023 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:55.965789 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-61f2edb7-8375-4bd3-88d0-c56520447023 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.966237 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-61f2edb7-8375-4bd3-88d0-c56520447023 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:55.967044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-61f2edb7-8375-4bd3-88d0-c56520447023 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:55.967480 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-61f2edb7-8375-4bd3-88d0-c56520447023 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:56.027662 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-61f2edb7-8375-4bd3-88d0-c56520447023 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:56.035057 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-61f2edb7-8375-4bd3-88d0-c56520447023 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.079933 May 19 13:54:56.035624 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 54/108] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:55 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:56.400549 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c00dfdaf-948e-4f67-a05a-4fcb78913fb0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:56.401153 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c00dfdaf-948e-4f67-a05a-4fcb78913fb0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:56.407242 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c00dfdaf-948e-4f67-a05a-4fcb78913fb0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:56.407684 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c00dfdaf-948e-4f67-a05a-4fcb78913fb0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:56.408478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c00dfdaf-948e-4f67-a05a-4fcb78913fb0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:56.408860 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c00dfdaf-948e-4f67-a05a-4fcb78913fb0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:56.468163 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c00dfdaf-948e-4f67-a05a-4fcb78913fb0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:56.475430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c00dfdaf-948e-4f67-a05a-4fcb78913fb0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.078720 May 19 13:54:56.475985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 55/109] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:56 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:56.602627 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:56.603268 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:56.605947 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=4 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:56.611468 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:56.611911 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:56.612663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:56.613089 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:56.677795 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:56.686230 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:56.688053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:56.689154 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0464aecc-f86e-40a7-a1f1-5f309ad0fc31 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1341 microversion: 2.20 time: 0.090529 May 19 13:54:56.689701 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 55/110] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:56 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:54:56.752949 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f2fe6fad-682d-4597-b4f4-c9ea0321c078 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:56.753855 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f2fe6fad-682d-4597-b4f4-c9ea0321c078 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:56.759906 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f2fe6fad-682d-4597-b4f4-c9ea0321c078 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:56.760353 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f2fe6fad-682d-4597-b4f4-c9ea0321c078 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:56.761177 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f2fe6fad-682d-4597-b4f4-c9ea0321c078 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:56.762268 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f2fe6fad-682d-4597-b4f4-c9ea0321c078 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:56.888678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f2fe6fad-682d-4597-b4f4-c9ea0321c078 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:56.896072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f2fe6fad-682d-4597-b4f4-c9ea0321c078 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.147174 May 19 13:54:56.896627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 56/111] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:56 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:56.902899 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1255652d-200b-4526-8cf1-c254e3d49120 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:56.903506 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1255652d-200b-4526-8cf1-c254e3d49120 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:56.909454 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1255652d-200b-4526-8cf1-c254e3d49120 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:56.909830 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1255652d-200b-4526-8cf1-c254e3d49120 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:56.910577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1255652d-200b-4526-8cf1-c254e3d49120 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:56.911041 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1255652d-200b-4526-8cf1-c254e3d49120 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:57.037969 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1255652d-200b-4526-8cf1-c254e3d49120 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:57.045986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1255652d-200b-4526-8cf1-c254e3d49120 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.147022 May 19 13:54:57.046620 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 56/112] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:56 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:57.051904 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-85e293c5-901e-4345-b912-ae556c2cf417 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:57.052508 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-85e293c5-901e-4345-b912-ae556c2cf417 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:57.059057 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85e293c5-901e-4345-b912-ae556c2cf417 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:57.059503 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85e293c5-901e-4345-b912-ae556c2cf417 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:57.060249 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85e293c5-901e-4345-b912-ae556c2cf417 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:57.060679 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85e293c5-901e-4345-b912-ae556c2cf417 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:57.122306 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-85e293c5-901e-4345-b912-ae556c2cf417 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:57.129880 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-85e293c5-901e-4345-b912-ae556c2cf417 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.081693 May 19 13:54:57.130440 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 57/113] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:57 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:57.492338 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f21eadd6-9711-4646-a5e5-742500624a3f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:57.492947 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f21eadd6-9711-4646-a5e5-742500624a3f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:57.499204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f21eadd6-9711-4646-a5e5-742500624a3f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:57.499673 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f21eadd6-9711-4646-a5e5-742500624a3f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:57.500427 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f21eadd6-9711-4646-a5e5-742500624a3f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:57.500862 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f21eadd6-9711-4646-a5e5-742500624a3f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:57.561574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f21eadd6-9711-4646-a5e5-742500624a3f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:57.569175 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f21eadd6-9711-4646-a5e5-742500624a3f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.080688 May 19 13:54:57.569898 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 57/114] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:57 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:57.707735 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:57.708356 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:57.715186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:57.715636 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:57.716382 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:57.716808 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:57.776144 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:57.784885 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:57.786376 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:57.787512 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-188cdac4-48a7-4da9-ae25-f09722a2ee34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1341 microversion: 2.20 time: 0.083641 May 19 13:54:57.788089 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 58/115] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:57 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1341 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:54:57.912624 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3aed8925-451c-4db9-bef2-61bbc54a5412 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:57.913240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3aed8925-451c-4db9-bef2-61bbc54a5412 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:57.919659 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3aed8925-451c-4db9-bef2-61bbc54a5412 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:57.920110 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3aed8925-451c-4db9-bef2-61bbc54a5412 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:57.920868 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3aed8925-451c-4db9-bef2-61bbc54a5412 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:57.922232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3aed8925-451c-4db9-bef2-61bbc54a5412 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:58.051592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3aed8925-451c-4db9-bef2-61bbc54a5412 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:58.060017 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3aed8925-451c-4db9-bef2-61bbc54a5412 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.151250 May 19 13:54:58.060624 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 58/116] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:57 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:58.063806 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e064715a-55c6-488c-b11b-d6f998799be2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:58.064583 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e064715a-55c6-488c-b11b-d6f998799be2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:58.071913 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e064715a-55c6-488c-b11b-d6f998799be2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:58.072480 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e064715a-55c6-488c-b11b-d6f998799be2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:58.073525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e064715a-55c6-488c-b11b-d6f998799be2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:58.074829 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e064715a-55c6-488c-b11b-d6f998799be2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:58.146978 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2e3e1146-db5a-4b9d-af80-74377d149d56 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:58.147563 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2e3e1146-db5a-4b9d-af80-74377d149d56 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:58.154432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2e3e1146-db5a-4b9d-af80-74377d149d56 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:58.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2e3e1146-db5a-4b9d-af80-74377d149d56 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:58.155690 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2e3e1146-db5a-4b9d-af80-74377d149d56 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:58.156127 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2e3e1146-db5a-4b9d-af80-74377d149d56 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:58.158212 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=14 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:58.323152 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2e3e1146-db5a-4b9d-af80-74377d149d56 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:58.331650 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2e3e1146-db5a-4b9d-af80-74377d149d56 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.188608 May 19 13:54:58.332211 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 59/117] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:58 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:58.380733 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e064715a-55c6-488c-b11b-d6f998799be2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:58.388821 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e064715a-55c6-488c-b11b-d6f998799be2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.331122 May 19 13:54:58.389390 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 59/118] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:58 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:58.587306 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-570a8a56-6a41-4909-babf-6c93474298f0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:58.587909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-570a8a56-6a41-4909-babf-6c93474298f0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:58.589861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=10 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:58.595447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-570a8a56-6a41-4909-babf-6c93474298f0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:58.596561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-570a8a56-6a41-4909-babf-6c93474298f0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:58.596700 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-570a8a56-6a41-4909-babf-6c93474298f0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:58.597083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-570a8a56-6a41-4909-babf-6c93474298f0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:58.658550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-570a8a56-6a41-4909-babf-6c93474298f0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:58.665899 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-570a8a56-6a41-4909-babf-6c93474298f0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.082448 May 19 13:54:58.673487 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 60/119] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:58 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:58.804854 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:58.805455 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:58.807326 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=6 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:54:58.812719 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:58.813392 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:58.814192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:58.814623 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:58.876381 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:58.884505 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:58.886019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:58.887384 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5ff4458d-197e-4183-9c09-e77f7d9c0c98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1341 microversion: 2.20 time: 0.086424 May 19 13:54:58.887943 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 60/120] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:58 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1341 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:54:59.077590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-78707373-8093-4b4e-8d8f-e484cbd28305 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:59.078126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-78707373-8093-4b4e-8d8f-e484cbd28305 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:59.084222 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-78707373-8093-4b4e-8d8f-e484cbd28305 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.084673 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-78707373-8093-4b4e-8d8f-e484cbd28305 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.085446 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-78707373-8093-4b4e-8d8f-e484cbd28305 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.085867 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-78707373-8093-4b4e-8d8f-e484cbd28305 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.212306 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-78707373-8093-4b4e-8d8f-e484cbd28305 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:59.220260 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-78707373-8093-4b4e-8d8f-e484cbd28305 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.147140 May 19 13:54:59.220819 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 61/121] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:59 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:59.349186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0b534a9e-e2e1-4249-b7f9-3f73621fc28e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:59.349707 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0b534a9e-e2e1-4249-b7f9-3f73621fc28e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:59.355760 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b534a9e-e2e1-4249-b7f9-3f73621fc28e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.356203 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b534a9e-e2e1-4249-b7f9-3f73621fc28e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.356952 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b534a9e-e2e1-4249-b7f9-3f73621fc28e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.357384 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b534a9e-e2e1-4249-b7f9-3f73621fc28e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.406576 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-62aaa291-ee57-496f-8fcc-1fc5d5851b61 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:59.407306 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-62aaa291-ee57-496f-8fcc-1fc5d5851b61 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:59.413536 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-62aaa291-ee57-496f-8fcc-1fc5d5851b61 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.413985 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-62aaa291-ee57-496f-8fcc-1fc5d5851b61 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.414948 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-62aaa291-ee57-496f-8fcc-1fc5d5851b61 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.415202 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-62aaa291-ee57-496f-8fcc-1fc5d5851b61 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.416801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0b534a9e-e2e1-4249-b7f9-3f73621fc28e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:59.424301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0b534a9e-e2e1-4249-b7f9-3f73621fc28e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1218 microversion: 2.1 time: 0.079040 May 19 13:54:59.424863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 61/122] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:59 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:59.542246 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-62aaa291-ee57-496f-8fcc-1fc5d5851b61 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:59.551094 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-62aaa291-ee57-496f-8fcc-1fc5d5851b61 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.149457 May 19 13:54:59.551667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 62/123] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:59 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:54:59.683796 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-185f2435-92b1-4b8f-8871-d94853d2155f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:59.684411 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-185f2435-92b1-4b8f-8871-d94853d2155f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:59.690362 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-185f2435-92b1-4b8f-8871-d94853d2155f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.690810 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-185f2435-92b1-4b8f-8871-d94853d2155f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.691599 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-185f2435-92b1-4b8f-8871-d94853d2155f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.692035 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-185f2435-92b1-4b8f-8871-d94853d2155f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.752904 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-185f2435-92b1-4b8f-8871-d94853d2155f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:59.760512 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-185f2435-92b1-4b8f-8871-d94853d2155f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1293 microversion: 2.1 time: 0.081084 May 19 13:54:59.761187 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 62/124] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:54:59 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:54:59.905160 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:54:59.905693 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:54:59.911783 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.912213 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.912964 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:54:59.913393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:54:59.972490 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:59.980745 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:59.982239 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:54:59.983365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-de9f2b79-5316-4871-89c1-6f3868880f18 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1341 microversion: 2.20 time: 0.082371 May 19 13:54:59.983909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 63/125] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:54:59 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1341 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:00.237959 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4562d2fe-dd44-4d00-87a6-c680532cca7e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:00.239306 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4562d2fe-dd44-4d00-87a6-c680532cca7e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:00.247120 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4562d2fe-dd44-4d00-87a6-c680532cca7e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:00.247855 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4562d2fe-dd44-4d00-87a6-c680532cca7e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:00.248814 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4562d2fe-dd44-4d00-87a6-c680532cca7e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:00.249433 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4562d2fe-dd44-4d00-87a6-c680532cca7e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:00.441488 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-872fdfa7-4e9b-4b48-9fe7-44ac8649ed10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:00.443066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-872fdfa7-4e9b-4b48-9fe7-44ac8649ed10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:00.451732 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-872fdfa7-4e9b-4b48-9fe7-44ac8649ed10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:00.452142 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-872fdfa7-4e9b-4b48-9fe7-44ac8649ed10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:00.453188 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-872fdfa7-4e9b-4b48-9fe7-44ac8649ed10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:00.453760 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-872fdfa7-4e9b-4b48-9fe7-44ac8649ed10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:00.534297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-872fdfa7-4e9b-4b48-9fe7-44ac8649ed10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:00.545309 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-872fdfa7-4e9b-4b48-9fe7-44ac8649ed10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1266 microversion: 2.1 time: 0.107934 May 19 13:55:00.555635 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 64/126] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:00 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:00.571256 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-88b514d1-7c99-49a9-90e5-58ca092120fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:00.572521 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-88b514d1-7c99-49a9-90e5-58ca092120fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:00.576131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4562d2fe-dd44-4d00-87a6-c680532cca7e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:00.584526 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-88b514d1-7c99-49a9-90e5-58ca092120fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:00.584976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-88b514d1-7c99-49a9-90e5-58ca092120fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:00.586050 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-88b514d1-7c99-49a9-90e5-58ca092120fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:00.586563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4562d2fe-dd44-4d00-87a6-c680532cca7e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.352978 May 19 13:55:00.586999 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-88b514d1-7c99-49a9-90e5-58ca092120fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:00.587977 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 63/127] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:00 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:00.782329 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-305b6abc-36b0-4970-a658-091f51b99716 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:00.783095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-305b6abc-36b0-4970-a658-091f51b99716 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:00.790797 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-88b514d1-7c99-49a9-90e5-58ca092120fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:00.793479 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-305b6abc-36b0-4970-a658-091f51b99716 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:00.795169 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-305b6abc-36b0-4970-a658-091f51b99716 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:00.795992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-305b6abc-36b0-4970-a658-091f51b99716 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:00.822679 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-305b6abc-36b0-4970-a658-091f51b99716 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:00.824859 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-88b514d1-7c99-49a9-90e5-58ca092120fa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.259634 May 19 13:55:00.834143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 65/128] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:00 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:00.967358 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-305b6abc-36b0-4970-a658-091f51b99716 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:00.983105 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-305b6abc-36b0-4970-a658-091f51b99716 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1299 microversion: 2.1 time: 0.205298 May 19 13:55:00.996199 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 64/129] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:00 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1299 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:01.002475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:01.003486 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:01.014532 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:01.014532 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:01.015302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:01.015771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:01.534101 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:01.556233 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:01.563764 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:01.570065 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e583170b-9f5c-4924-9e7b-8f4d91679c30 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:01.571002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-53856cd9-6b4f-4251-b61c-f1235ccf7553 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1339 microversion: 2.20 time: 0.571939 May 19 13:55:01.576679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 66/130] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:00 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1339 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:01.578815 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e583170b-9f5c-4924-9e7b-8f4d91679c30 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:01.587955 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:01.597173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e583170b-9f5c-4924-9e7b-8f4d91679c30 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:01.602577 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e583170b-9f5c-4924-9e7b-8f4d91679c30 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:01.605594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e583170b-9f5c-4924-9e7b-8f4d91679c30 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:01.606310 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e583170b-9f5c-4924-9e7b-8f4d91679c30 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:01.609454 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b0c649bd-f94b-438e-895b-1463bcb20ae6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:01.610395 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b0c649bd-f94b-438e-895b-1463bcb20ae6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:01.618887 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=100 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:01.624265 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b0c649bd-f94b-438e-895b-1463bcb20ae6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:01.625648 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b0c649bd-f94b-438e-895b-1463bcb20ae6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:01.629207 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b0c649bd-f94b-438e-895b-1463bcb20ae6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:01.631203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b0c649bd-f94b-438e-895b-1463bcb20ae6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:01.972650 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e583170b-9f5c-4924-9e7b-8f4d91679c30 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:01.987408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e583170b-9f5c-4924-9e7b-8f4d91679c30 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1272 microversion: 2.1 time: 0.427164 May 19 13:55:02.007356 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 65/131] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:01 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1272 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:02.176022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-e93fec02-9ee7-4d29-9b48-b733f51d01ae req-65df56db-17ce-4ad3-9cf0-0f255d82f39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0a5331-be2a-4c5b-80ac-6be7220f2516", "name": "network-vif-plugged", "status": "completed", "tag": "1c2ca481-d8b3-43c5-9df6-5b028371dcf0"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:02.192720 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-e93fec02-9ee7-4d29-9b48-b733f51d01ae req-65df56db-17ce-4ad3-9cf0-0f255d82f39a service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:02.195640 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-e93fec02-9ee7-4d29-9b48-b733f51d01ae req-65df56db-17ce-4ad3-9cf0-0f255d82f39a service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:02.229221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-e93fec02-9ee7-4d29-9b48-b733f51d01ae req-65df56db-17ce-4ad3-9cf0-0f255d82f39a service nova] Creating event network-vif-plugged:1c2ca481-d8b3-43c5-9df6-5b028371dcf0 for instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 on hv-cinder-78481 May 19 13:55:02.235605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-e93fec02-9ee7-4d29-9b48-b733f51d01ae req-65df56db-17ce-4ad3-9cf0-0f255d82f39a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226605 May 19 13:55:02.236270 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 66/132] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:02.245910 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ffd14311-6657-4d7b-a315-ef0a108ff4ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:02.246610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ffd14311-6657-4d7b-a315-ef0a108ff4ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:02.253521 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffd14311-6657-4d7b-a315-ef0a108ff4ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:02.254191 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffd14311-6657-4d7b-a315-ef0a108ff4ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:02.255172 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffd14311-6657-4d7b-a315-ef0a108ff4ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:02.255885 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffd14311-6657-4d7b-a315-ef0a108ff4ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:02.317066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b0c649bd-f94b-438e-895b-1463bcb20ae6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:02.322084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:02.335916 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b0c649bd-f94b-438e-895b-1463bcb20ae6 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.733869 May 19 13:55:02.346710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 67/133] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:01 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:02.355955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b78e9d0b-58d1-49be-b4cf-f6be7c7d0136 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:02.356950 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b78e9d0b-58d1-49be-b4cf-f6be7c7d0136 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:02.363488 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b78e9d0b-58d1-49be-b4cf-f6be7c7d0136 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:02.364140 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b78e9d0b-58d1-49be-b4cf-f6be7c7d0136 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:02.365125 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b78e9d0b-58d1-49be-b4cf-f6be7c7d0136 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:02.365698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b78e9d0b-58d1-49be-b4cf-f6be7c7d0136 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:02.641620 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b78e9d0b-58d1-49be-b4cf-f6be7c7d0136 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:02.654941 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b78e9d0b-58d1-49be-b4cf-f6be7c7d0136 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1299 microversion: 2.1 time: 0.306778 May 19 13:55:02.656330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 68/134] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:02 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1299 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:02.662286 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:02.663350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:02.681352 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:02.682035 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:02.684389 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:02.685291 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:02.784939 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ffd14311-6657-4d7b-a315-ef0a108ff4ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:02.800377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ffd14311-6657-4d7b-a315-ef0a108ff4ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.558707 May 19 13:55:02.801161 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 67/135] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:02 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:03.006234 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:03.015137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-184f5d6f-641b-4116-8332-5ba4e0ab8be9 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:03.015800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-184f5d6f-641b-4116-8332-5ba4e0ab8be9 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:03.017946 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:03.020653 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:03.022745 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d5614bc7-148e-47eb-b026-16ed6ca82576 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.365233 May 19 13:55:03.023828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 69/136] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:02 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:03.033627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-184f5d6f-641b-4116-8332-5ba4e0ab8be9 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:03.033627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-184f5d6f-641b-4116-8332-5ba4e0ab8be9 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:03.033627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-184f5d6f-641b-4116-8332-5ba4e0ab8be9 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:03.033627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-184f5d6f-641b-4116-8332-5ba4e0ab8be9 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:03.126949 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-184f5d6f-641b-4116-8332-5ba4e0ab8be9 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:03.146136 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-184f5d6f-641b-4116-8332-5ba4e0ab8be9 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1272 microversion: 2.1 time: 0.135391 May 19 13:55:03.149560 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 68/137] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:03 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:03.344332 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-8d7b0c65-af01-4274-b9bc-69f5d0f8592b req-b0f7a415-8ea6-4f6e-a17e-185fb1ef3c77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4e2c2f-4753-4911-8859-73736543f959", "tag": "5e326997-1358-457a-8426-4184a94bfdad"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:03.353834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dcae6531-e83e-4a31-975b-1f3ded4a765f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:03.355761 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dcae6531-e83e-4a31-975b-1f3ded4a765f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:03.365289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dcae6531-e83e-4a31-975b-1f3ded4a765f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:03.365661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-8d7b0c65-af01-4274-b9bc-69f5d0f8592b req-b0f7a415-8ea6-4f6e-a17e-185fb1ef3c77 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:03.366459 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-8d7b0c65-af01-4274-b9bc-69f5d0f8592b req-b0f7a415-8ea6-4f6e-a17e-185fb1ef3c77 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:03.368185 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dcae6531-e83e-4a31-975b-1f3ded4a765f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:03.369008 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dcae6531-e83e-4a31-975b-1f3ded4a765f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:03.369444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dcae6531-e83e-4a31-975b-1f3ded4a765f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:03.399794 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-8d7b0c65-af01-4274-b9bc-69f5d0f8592b req-b0f7a415-8ea6-4f6e-a17e-185fb1ef3c77 service nova] Creating event network-changed:5e326997-1358-457a-8426-4184a94bfdad for instance 5c4e2c2f-4753-4911-8859-73736543f959 on hv-cinder-78481 May 19 13:55:03.408555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-8d7b0c65-af01-4274-b9bc-69f5d0f8592b req-b0f7a415-8ea6-4f6e-a17e-185fb1ef3c77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069325 May 19 13:55:03.409724 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 70/138] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:03.562114 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-dcae6531-e83e-4a31-975b-1f3ded4a765f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:03.569904 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dcae6531-e83e-4a31-975b-1f3ded4a765f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.220075 May 19 13:55:03.570480 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 69/139] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:03 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:03.673990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d70b748a-61ba-4fca-ad10-2ba855c73502 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:03.674642 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d70b748a-61ba-4fca-ad10-2ba855c73502 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:03.676604 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:03.681998 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d70b748a-61ba-4fca-ad10-2ba855c73502 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:03.682441 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d70b748a-61ba-4fca-ad10-2ba855c73502 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:03.683798 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d70b748a-61ba-4fca-ad10-2ba855c73502 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:03.684232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d70b748a-61ba-4fca-ad10-2ba855c73502 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:03.811899 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d70b748a-61ba-4fca-ad10-2ba855c73502 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:03.818491 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6fae361d-853d-44ff-81fa-bed900810946 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:03.819155 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6fae361d-853d-44ff-81fa-bed900810946 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:03.819690 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d70b748a-61ba-4fca-ad10-2ba855c73502 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.150974 May 19 13:55:03.820255 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 71/140] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:03 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:03.825766 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fae361d-853d-44ff-81fa-bed900810946 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:03.826217 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fae361d-853d-44ff-81fa-bed900810946 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:03.827002 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fae361d-853d-44ff-81fa-bed900810946 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:03.827435 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fae361d-853d-44ff-81fa-bed900810946 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:03.955769 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6fae361d-853d-44ff-81fa-bed900810946 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:03.963204 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6fae361d-853d-44ff-81fa-bed900810946 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.148477 May 19 13:55:03.963800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 70/141] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:03 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:04.040770 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:04.041422 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:04.047492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.047940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.048699 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.049135 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.165349 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6ce9958f-d7ce-4cd0-a918-956cf4c793bd tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:04.166243 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6ce9958f-d7ce-4cd0-a918-956cf4c793bd tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:04.173214 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ce9958f-d7ce-4cd0-a918-956cf4c793bd tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.173994 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ce9958f-d7ce-4cd0-a918-956cf4c793bd tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.175041 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ce9958f-d7ce-4cd0-a918-956cf4c793bd tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.175678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ce9958f-d7ce-4cd0-a918-956cf4c793bd tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.194259 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:04.204332 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:04.205889 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:04.207065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f17d207f-5585-438c-b435-c89a30ba5b8c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.170183 May 19 13:55:04.207634 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 72/142] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:04 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:04.256247 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-9fcb0f5c-6775-4330-8dc4-4f9fc6a30179 req-54a44348-d732-43cb-868d-3fc9ffc98510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac7a1c-80e3-46ab-a5a0-2135ac395d2f", "name": "network-vif-plugged", "status": "completed", "tag": "9c788124-2671-444c-98f8-1098c854377e"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:04.266505 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-9fcb0f5c-6775-4330-8dc4-4f9fc6a30179 req-54a44348-d732-43cb-868d-3fc9ffc98510 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.267157 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-9fcb0f5c-6775-4330-8dc4-4f9fc6a30179 req-54a44348-d732-43cb-868d-3fc9ffc98510 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.279282 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-9fcb0f5c-6775-4330-8dc4-4f9fc6a30179 req-54a44348-d732-43cb-868d-3fc9ffc98510 service nova] Creating event network-vif-plugged:9c788124-2671-444c-98f8-1098c854377e for instance aaac7a1c-80e3-46ab-a5a0-2135ac395d2f on hv-cinder-78481 May 19 13:55:04.284293 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-9fcb0f5c-6775-4330-8dc4-4f9fc6a30179 req-54a44348-d732-43cb-868d-3fc9ffc98510 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034668 May 19 13:55:04.285182 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 73/143] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:55:04.321103 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6ce9958f-d7ce-4cd0-a918-956cf4c793bd tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:04.329716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6ce9958f-d7ce-4cd0-a918-956cf4c793bd tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.168119 May 19 13:55:04.330390 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 71/144] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:04 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:04.590447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7d3454ec-298e-48a3-a1c9-911fe219d518 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:04.591265 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7d3454ec-298e-48a3-a1c9-911fe219d518 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:04.597607 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7d3454ec-298e-48a3-a1c9-911fe219d518 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.598053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7d3454ec-298e-48a3-a1c9-911fe219d518 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.598805 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7d3454ec-298e-48a3-a1c9-911fe219d518 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.599267 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7d3454ec-298e-48a3-a1c9-911fe219d518 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.728544 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7d3454ec-298e-48a3-a1c9-911fe219d518 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:04.736165 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7d3454ec-298e-48a3-a1c9-911fe219d518 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.150466 May 19 13:55:04.736721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 74/145] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:04 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:04.837379 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c16070d0-dec7-4c98-888b-1e6e2ee913ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:04.837922 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c16070d0-dec7-4c98-888b-1e6e2ee913ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:04.843976 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c16070d0-dec7-4c98-888b-1e6e2ee913ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.844425 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c16070d0-dec7-4c98-888b-1e6e2ee913ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.845184 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c16070d0-dec7-4c98-888b-1e6e2ee913ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.845617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c16070d0-dec7-4c98-888b-1e6e2ee913ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.971230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c16070d0-dec7-4c98-888b-1e6e2ee913ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:04.978614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c16070d0-dec7-4c98-888b-1e6e2ee913ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.145149 May 19 13:55:04.979201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 72/146] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:04 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:04.980475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-98527ea1-00ac-4296-870f-0cfd1b29a668 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:04.981055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-98527ea1-00ac-4296-870f-0cfd1b29a668 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:04.987109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98527ea1-00ac-4296-870f-0cfd1b29a668 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.987555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98527ea1-00ac-4296-870f-0cfd1b29a668 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:04.988307 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98527ea1-00ac-4296-870f-0cfd1b29a668 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:04.988736 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98527ea1-00ac-4296-870f-0cfd1b29a668 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:05.117035 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-98527ea1-00ac-4296-870f-0cfd1b29a668 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:05.125240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-98527ea1-00ac-4296-870f-0cfd1b29a668 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.148895 May 19 13:55:05.125797 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 75/147] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:04 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:05.224884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:05.225481 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:05.234427 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:05.234427 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:05.234932 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:05.235389 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:05.346390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-90fe58fc-499a-42e7-a467-234c3e99e45d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:05.347828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-90fe58fc-499a-42e7-a467-234c3e99e45d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:05.358106 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-90fe58fc-499a-42e7-a467-234c3e99e45d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:05.358801 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-90fe58fc-499a-42e7-a467-234c3e99e45d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:05.359819 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-90fe58fc-499a-42e7-a467-234c3e99e45d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:05.360383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-90fe58fc-499a-42e7-a467-234c3e99e45d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:05.932946 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:05.941449 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:05.943703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:05.945298 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7cb091ec-fe3c-418a-ab29-046bdf46c8b5 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.724504 May 19 13:55:05.946103 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 73/148] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:05 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:05.952407 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7bd89001-7ea9-454d-bc64-2c7c1baadf38 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:05.953301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7bd89001-7ea9-454d-bc64-2c7c1baadf38 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:05.959898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7bd89001-7ea9-454d-bc64-2c7c1baadf38 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:05.960610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7bd89001-7ea9-454d-bc64-2c7c1baadf38 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:05.961416 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7bd89001-7ea9-454d-bc64-2c7c1baadf38 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:05.961922 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7bd89001-7ea9-454d-bc64-2c7c1baadf38 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:06.077966 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-90fe58fc-499a-42e7-a467-234c3e99e45d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:06.086231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-90fe58fc-499a-42e7-a467-234c3e99e45d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.743746 May 19 13:55:06.087267 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 76/149] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:05 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:06.092700 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3a092041-fddb-4ca6-9077-91486b589727 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:06.093310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3a092041-fddb-4ca6-9077-91486b589727 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:06.099340 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3a092041-fddb-4ca6-9077-91486b589727 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:06.099869 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3a092041-fddb-4ca6-9077-91486b589727 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:06.101013 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3a092041-fddb-4ca6-9077-91486b589727 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:06.101600 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3a092041-fddb-4ca6-9077-91486b589727 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:06.307025 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7bd89001-7ea9-454d-bc64-2c7c1baadf38 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:06.317811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7bd89001-7ea9-454d-bc64-2c7c1baadf38 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.369601 May 19 13:55:06.327518 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 74/150] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:05 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:06.327949 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fbfb302f-14af-4082-92ed-0de1b5bb6266 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:06.328476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fbfb302f-14af-4082-92ed-0de1b5bb6266 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:06.337027 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbfb302f-14af-4082-92ed-0de1b5bb6266 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:06.337818 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbfb302f-14af-4082-92ed-0de1b5bb6266 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:06.338836 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbfb302f-14af-4082-92ed-0de1b5bb6266 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:06.340465 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbfb302f-14af-4082-92ed-0de1b5bb6266 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:06.661993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3a092041-fddb-4ca6-9077-91486b589727 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:06.670537 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3a092041-fddb-4ca6-9077-91486b589727 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.581978 May 19 13:55:06.671168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 77/151] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:06 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:06.701241 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fbfb302f-14af-4082-92ed-0de1b5bb6266 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:06.709507 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fbfb302f-14af-4082-92ed-0de1b5bb6266 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.386859 May 19 13:55:06.710761 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 75/152] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:06 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:06.964362 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:06.965931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:06.972880 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:06.973413 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:06.974276 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:06.974779 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.122778 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-654e060c-bbdc-41ab-adba-ab5b93ea7fa7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:07.123448 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-654e060c-bbdc-41ab-adba-ab5b93ea7fa7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:07.137833 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-654e060c-bbdc-41ab-adba-ab5b93ea7fa7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.138569 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-654e060c-bbdc-41ab-adba-ab5b93ea7fa7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.139507 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-654e060c-bbdc-41ab-adba-ab5b93ea7fa7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.140098 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-654e060c-bbdc-41ab-adba-ab5b93ea7fa7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.295069 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:07.320921 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:07.327083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:07.328498 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e5c6da3a-caa8-4388-b31e-2d04fa0adc40 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.368421 May 19 13:55:07.329533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 78/153] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:06 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:07.336897 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-b368230a-edbc-465e-8c5a-b0fa301fd379 req-99fe8316-1413-4ca2-869e-2555f2135e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e425ccc-4508-4267-bc69-5590c1f503ec", "tag": "a4da582a-6527-48e4-b52c-7d888d7e053a"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:07.357951 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-b368230a-edbc-465e-8c5a-b0fa301fd379 req-99fe8316-1413-4ca2-869e-2555f2135e0d service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.358398 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-b368230a-edbc-465e-8c5a-b0fa301fd379 req-99fe8316-1413-4ca2-869e-2555f2135e0d service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.374726 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-b368230a-edbc-465e-8c5a-b0fa301fd379 req-99fe8316-1413-4ca2-869e-2555f2135e0d service nova] Creating event network-changed:a4da582a-6527-48e4-b52c-7d888d7e053a for instance 2e425ccc-4508-4267-bc69-5590c1f503ec on hv-cinder-78481 May 19 13:55:07.382701 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-b368230a-edbc-465e-8c5a-b0fa301fd379 req-99fe8316-1413-4ca2-869e-2555f2135e0d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049782 May 19 13:55:07.403471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 79/154] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:07.409371 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c706b37f-e3be-42d6-9816-59ca85176549 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:07.410065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c706b37f-e3be-42d6-9816-59ca85176549 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:07.416590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c706b37f-e3be-42d6-9816-59ca85176549 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.417038 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c706b37f-e3be-42d6-9816-59ca85176549 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.418324 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c706b37f-e3be-42d6-9816-59ca85176549 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.419119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c706b37f-e3be-42d6-9816-59ca85176549 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.591489 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-654e060c-bbdc-41ab-adba-ab5b93ea7fa7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:07.599644 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-654e060c-bbdc-41ab-adba-ab5b93ea7fa7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.499485 May 19 13:55:07.610449 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 76/155] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:07 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:07.615557 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-b9d0a428-57be-40d6-9d2a-d272c9737dbe req-5dfcb11e-e336-46c8-b19a-02de33476663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d532aab-b9b2-43ad-8536-36ac47c34097", "name": "network-vif-plugged", "status": "completed", "tag": "b7ff7282-c5a8-4eda-8af0-d48c8e33d4ad"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:07.625004 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-b9d0a428-57be-40d6-9d2a-d272c9737dbe req-5dfcb11e-e336-46c8-b19a-02de33476663 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.625668 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-b9d0a428-57be-40d6-9d2a-d272c9737dbe req-5dfcb11e-e336-46c8-b19a-02de33476663 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.639272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-b9d0a428-57be-40d6-9d2a-d272c9737dbe req-5dfcb11e-e336-46c8-b19a-02de33476663 service nova] Creating event network-vif-plugged:b7ff7282-c5a8-4eda-8af0-d48c8e33d4ad for instance 2d532aab-b9b2-43ad-8536-36ac47c34097 on hv-cinder-78481 May 19 13:55:07.645717 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-b9d0a428-57be-40d6-9d2a-d272c9737dbe req-5dfcb11e-e336-46c8-b19a-02de33476663 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033971 May 19 13:55:07.646369 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 77/156] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:07.670727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c706b37f-e3be-42d6-9816-59ca85176549 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:07.678912 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c706b37f-e3be-42d6-9816-59ca85176549 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.274187 May 19 13:55:07.689709 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0e1be767-c6b9-4e54-9490-499039da3138 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:07.690232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 80/157] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:07 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:07.690498 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0e1be767-c6b9-4e54-9490-499039da3138 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:07.722907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0e1be767-c6b9-4e54-9490-499039da3138 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.723402 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0e1be767-c6b9-4e54-9490-499039da3138 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.724198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0e1be767-c6b9-4e54-9490-499039da3138 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.724630 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0e1be767-c6b9-4e54-9490-499039da3138 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.726491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-36b44863-bebb-49b2-a548-f21927c3a0e2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:07.727202 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-36b44863-bebb-49b2-a548-f21927c3a0e2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:07.736572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-36b44863-bebb-49b2-a548-f21927c3a0e2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.744121 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-36b44863-bebb-49b2-a548-f21927c3a0e2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.745931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-36b44863-bebb-49b2-a548-f21927c3a0e2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:07.746570 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-36b44863-bebb-49b2-a548-f21927c3a0e2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:07.988794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0e1be767-c6b9-4e54-9490-499039da3138 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:07.994096 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-36b44863-bebb-49b2-a548-f21927c3a0e2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:07.997114 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0e1be767-c6b9-4e54-9490-499039da3138 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.314211 May 19 13:55:07.997747 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 78/158] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:07 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:08.004878 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-36b44863-bebb-49b2-a548-f21927c3a0e2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1322 microversion: 2.1 time: 0.282484 May 19 13:55:08.005712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 81/159] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:07 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:08.348143 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:08.349385 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:08.355924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:08.356635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:08.357394 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:08.357851 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:08.505846 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:08.520479 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:08.523283 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:08.525251 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-468c2cd4-348c-410a-9485-05ba9cbb364c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.181942 May 19 13:55:08.526614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 79/160] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:08 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:08.617227 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bfb514ff-1b7e-4034-af18-fc79ad23b531 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:08.617829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bfb514ff-1b7e-4034-af18-fc79ad23b531 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:08.624987 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bfb514ff-1b7e-4034-af18-fc79ad23b531 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:08.625440 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bfb514ff-1b7e-4034-af18-fc79ad23b531 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:08.626274 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bfb514ff-1b7e-4034-af18-fc79ad23b531 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:08.626710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bfb514ff-1b7e-4034-af18-fc79ad23b531 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:08.697040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2e5c4ac1-31f1-4c34-b046-007deb36ec59 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:08.697873 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2e5c4ac1-31f1-4c34-b046-007deb36ec59 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:08.705068 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e5c4ac1-31f1-4c34-b046-007deb36ec59 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:08.705719 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e5c4ac1-31f1-4c34-b046-007deb36ec59 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:08.707225 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e5c4ac1-31f1-4c34-b046-007deb36ec59 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:08.707889 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e5c4ac1-31f1-4c34-b046-007deb36ec59 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:08.833808 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bfb514ff-1b7e-4034-af18-fc79ad23b531 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:08.841757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bfb514ff-1b7e-4034-af18-fc79ad23b531 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.229043 May 19 13:55:08.842320 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 82/161] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:08 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:08.880128 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e5c4ac1-31f1-4c34-b046-007deb36ec59 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:08.888018 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2e5c4ac1-31f1-4c34-b046-007deb36ec59 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.195066 May 19 13:55:08.888589 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 80/162] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:08 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:09.014897 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-950a68ab-1eff-47e2-83ea-5ebbe601980f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:09.015519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-950a68ab-1eff-47e2-83ea-5ebbe601980f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:09.021994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-950a68ab-1eff-47e2-83ea-5ebbe601980f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.022441 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-950a68ab-1eff-47e2-83ea-5ebbe601980f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.023387 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-950a68ab-1eff-47e2-83ea-5ebbe601980f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.023819 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-950a68ab-1eff-47e2-83ea-5ebbe601980f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.024028 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-73bf8b9a-2c3b-433f-a1b2-01f69a25abdd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:09.024809 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-73bf8b9a-2c3b-433f-a1b2-01f69a25abdd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:09.031477 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73bf8b9a-2c3b-433f-a1b2-01f69a25abdd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.031929 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73bf8b9a-2c3b-433f-a1b2-01f69a25abdd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.032692 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73bf8b9a-2c3b-433f-a1b2-01f69a25abdd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.033295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73bf8b9a-2c3b-433f-a1b2-01f69a25abdd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.235717 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-950a68ab-1eff-47e2-83ea-5ebbe601980f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:09.236948 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-73bf8b9a-2c3b-433f-a1b2-01f69a25abdd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:09.244503 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-950a68ab-1eff-47e2-83ea-5ebbe601980f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.234900 May 19 13:55:09.245084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 83/163] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:09 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:09.250013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-73bf8b9a-2c3b-433f-a1b2-01f69a25abdd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1515 microversion: 2.1 time: 0.230370 May 19 13:55:09.250773 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 81/164] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:09 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1515 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:09.267738 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a89f5da1-54dd-439e-9b14-3a3bf00b9217 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:09.268797 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a89f5da1-54dd-439e-9b14-3a3bf00b9217 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:09.275341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a89f5da1-54dd-439e-9b14-3a3bf00b9217 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.275793 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a89f5da1-54dd-439e-9b14-3a3bf00b9217 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.276557 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a89f5da1-54dd-439e-9b14-3a3bf00b9217 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.277338 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a89f5da1-54dd-439e-9b14-3a3bf00b9217 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.338119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-a89f5da1-54dd-439e-9b14-3a3bf00b9217 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lazy-loading 'flavor' on Instance uuid aaac7a1c-80e3-46ab-a5a0-2135ac395d2f {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:55:09.420758 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-8f2a551e-f8de-4865-9bfd-de9951e858ed req-563c3cee-0b97-46d2-a9b3-2cb47416ff91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72fbcca9-a311-4ec9-b2b6-569b9a96e460", "tag": "12af5875-0105-4c5e-ab8b-4f48b11e4870"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:09.429154 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-8f2a551e-f8de-4865-9bfd-de9951e858ed req-563c3cee-0b97-46d2-a9b3-2cb47416ff91 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.429703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-8f2a551e-f8de-4865-9bfd-de9951e858ed req-563c3cee-0b97-46d2-a9b3-2cb47416ff91 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.432752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:09.443399 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-8f2a551e-f8de-4865-9bfd-de9951e858ed req-563c3cee-0b97-46d2-a9b3-2cb47416ff91 service nova] Creating event network-changed:12af5875-0105-4c5e-ab8b-4f48b11e4870 for instance 72fbcca9-a311-4ec9-b2b6-569b9a96e460 on hv-cinder-78481 May 19 13:55:09.448880 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-8f2a551e-f8de-4865-9bfd-de9951e858ed req-563c3cee-0b97-46d2-a9b3-2cb47416ff91 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032099 May 19 13:55:09.449768 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 82/165] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:09.460672 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a89f5da1-54dd-439e-9b14-3a3bf00b9217 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f/action" status: 200 len: 32 microversion: 2.1 time: 0.197512 May 19 13:55:09.464984 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 84/166] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 13:55:09 2022] POST /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f/action => generated 32 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:55:09.471102 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-569c1d7e-4305-46d1-afdf-0acac9685262 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:09.471924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-569c1d7e-4305-46d1-afdf-0acac9685262 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:09.478047 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-569c1d7e-4305-46d1-afdf-0acac9685262 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.478501 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-569c1d7e-4305-46d1-afdf-0acac9685262 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.479289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-569c1d7e-4305-46d1-afdf-0acac9685262 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.479726 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-569c1d7e-4305-46d1-afdf-0acac9685262 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.544390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:09.545078 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:09.554068 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.554068 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.554543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.555000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.665735 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-569c1d7e-4305-46d1-afdf-0acac9685262 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:09.668124 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=100 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:09.676117 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-569c1d7e-4305-46d1-afdf-0acac9685262 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.209573 May 19 13:55:09.676944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 83/167] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:09 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:09.712156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:09.720280 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:09.721790 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:09.723492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a92c5628-00c9-40ec-9bb2-58f238fb3e94 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.183181 May 19 13:55:09.724071 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 85/168] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:09 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:09.858415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e83a5037-cfec-4849-9049-353203999c1e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:09.859069 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e83a5037-cfec-4849-9049-353203999c1e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:09.865554 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e83a5037-cfec-4849-9049-353203999c1e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.866106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e83a5037-cfec-4849-9049-353203999c1e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.867104 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e83a5037-cfec-4849-9049-353203999c1e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.867397 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e83a5037-cfec-4849-9049-353203999c1e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.907214 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7def274e-d6bf-4f00-b8af-053ccc87d74e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:09.907935 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7def274e-d6bf-4f00-b8af-053ccc87d74e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:09.916832 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7def274e-d6bf-4f00-b8af-053ccc87d74e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.917276 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7def274e-d6bf-4f00-b8af-053ccc87d74e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:09.918042 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7def274e-d6bf-4f00-b8af-053ccc87d74e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:09.919846 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7def274e-d6bf-4f00-b8af-053ccc87d74e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:10.066208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e83a5037-cfec-4849-9049-353203999c1e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:10.074100 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e83a5037-cfec-4849-9049-353203999c1e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.220040 May 19 13:55:10.074951 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 84/169] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:09 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:10.104498 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7def274e-d6bf-4f00-b8af-053ccc87d74e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:10.111897 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7def274e-d6bf-4f00-b8af-053ccc87d74e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.210361 May 19 13:55:10.112533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 86/170] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:09 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:10.261276 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-61f9cf1e-8028-42d9-938c-76bf936c34d7 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:10.261881 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-61f9cf1e-8028-42d9-938c-76bf936c34d7 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:10.268653 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61f9cf1e-8028-42d9-938c-76bf936c34d7 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:10.269102 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61f9cf1e-8028-42d9-938c-76bf936c34d7 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:10.269867 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61f9cf1e-8028-42d9-938c-76bf936c34d7 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:10.270298 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61f9cf1e-8028-42d9-938c-76bf936c34d7 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:10.546167 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61f9cf1e-8028-42d9-938c-76bf936c34d7 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:10.556675 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-61f9cf1e-8028-42d9-938c-76bf936c34d7 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.299092 May 19 13:55:10.557385 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 85/171] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:10 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:10.693448 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c9fcfc17-d941-4e32-8ec5-4f2599fe75f7 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:10.694261 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c9fcfc17-d941-4e32-8ec5-4f2599fe75f7 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:10.700903 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c9fcfc17-d941-4e32-8ec5-4f2599fe75f7 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:10.701375 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c9fcfc17-d941-4e32-8ec5-4f2599fe75f7 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:10.702127 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c9fcfc17-d941-4e32-8ec5-4f2599fe75f7 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:10.702558 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c9fcfc17-d941-4e32-8ec5-4f2599fe75f7 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:10.742445 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:10.743106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:10.750342 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:10.751220 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:10.755439 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:10.755884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:10.893137 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c9fcfc17-d941-4e32-8ec5-4f2599fe75f7 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:10.901919 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c9fcfc17-d941-4e32-8ec5-4f2599fe75f7 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.212245 May 19 13:55:10.911806 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 87/172] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:10 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:10.926472 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:10.941620 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:10.943265 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:10.944407 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a80777cd-f0e0-435a-a156-e1bed1ecedf3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.205799 May 19 13:55:10.945102 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 86/173] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:10 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:55:11.092305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9283261f-f905-4c75-9043-6911df5ede5f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:11.093381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9283261f-f905-4c75-9043-6911df5ede5f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:11.107790 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9283261f-f905-4c75-9043-6911df5ede5f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.108608 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9283261f-f905-4c75-9043-6911df5ede5f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:11.109693 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9283261f-f905-4c75-9043-6911df5ede5f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.111110 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9283261f-f905-4c75-9043-6911df5ede5f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:11.129355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d8b6f3f6-d192-4b32-b0f0-9a26eedb4af3 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:11.129875 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d8b6f3f6-d192-4b32-b0f0-9a26eedb4af3 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:11.151019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8b6f3f6-d192-4b32-b0f0-9a26eedb4af3 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.151596 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8b6f3f6-d192-4b32-b0f0-9a26eedb4af3 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:11.152444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8b6f3f6-d192-4b32-b0f0-9a26eedb4af3 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.154341 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8b6f3f6-d192-4b32-b0f0-9a26eedb4af3 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:11.353210 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9283261f-f905-4c75-9043-6911df5ede5f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:11.363222 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9283261f-f905-4c75-9043-6911df5ede5f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.275068 May 19 13:55:11.364085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 88/174] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:11 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:11.365316 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d8b6f3f6-d192-4b32-b0f0-9a26eedb4af3 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:11.372955 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d8b6f3f6-d192-4b32-b0f0-9a26eedb4af3 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.247871 May 19 13:55:11.373527 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 87/175] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:11 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:11.573130 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-40ac0a17-1e89-4df0-99f2-bee9a933334e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:11.573740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-40ac0a17-1e89-4df0-99f2-bee9a933334e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:11.580612 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40ac0a17-1e89-4df0-99f2-bee9a933334e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.581057 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40ac0a17-1e89-4df0-99f2-bee9a933334e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:11.581815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40ac0a17-1e89-4df0-99f2-bee9a933334e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.582242 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40ac0a17-1e89-4df0-99f2-bee9a933334e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:11.720143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-40ac0a17-1e89-4df0-99f2-bee9a933334e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:11.727935 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-40ac0a17-1e89-4df0-99f2-bee9a933334e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.158489 May 19 13:55:11.728507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 89/176] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:11 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:11.919431 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f0f82638-b5b0-4277-880e-091fb9c40c7d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:11.920894 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f0f82638-b5b0-4277-880e-091fb9c40c7d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:11.927766 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f0f82638-b5b0-4277-880e-091fb9c40c7d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.928433 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f0f82638-b5b0-4277-880e-091fb9c40c7d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:11.929356 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f0f82638-b5b0-4277-880e-091fb9c40c7d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.929974 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f0f82638-b5b0-4277-880e-091fb9c40c7d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:11.963434 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:11.964061 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:11.975216 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.975667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:11.979419 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:11.984276 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:12.428570 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:12.432476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f0f82638-b5b0-4277-880e-091fb9c40c7d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:12.437984 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:12.439613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:12.440794 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-870bfd56-417a-498f-9195-0373564994e7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.481614 May 19 13:55:12.441529 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 90/177] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:11 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:12.446428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-03f94417-cd0e-4f8d-8a9c-30c1b3640e5e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:12.447038 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f0f82638-b5b0-4277-880e-091fb9c40c7d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.532000 May 19 13:55:12.447485 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-03f94417-cd0e-4f8d-8a9c-30c1b3640e5e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:12.447872 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 88/178] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:11 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:12.454832 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-03f94417-cd0e-4f8d-8a9c-30c1b3640e5e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:12.455577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-03f94417-cd0e-4f8d-8a9c-30c1b3640e5e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:12.456538 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-03f94417-cd0e-4f8d-8a9c-30c1b3640e5e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:12.457365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-03f94417-cd0e-4f8d-8a9c-30c1b3640e5e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:12.457887 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-17ab1fdb-d50a-49e2-8822-478745166416 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:12.458495 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-17ab1fdb-d50a-49e2-8822-478745166416 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:12.466206 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17ab1fdb-d50a-49e2-8822-478745166416 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:12.466755 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17ab1fdb-d50a-49e2-8822-478745166416 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:12.467576 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17ab1fdb-d50a-49e2-8822-478745166416 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:12.468018 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17ab1fdb-d50a-49e2-8822-478745166416 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:12.663160 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-03f94417-cd0e-4f8d-8a9c-30c1b3640e5e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:12.670369 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-17ab1fdb-d50a-49e2-8822-478745166416 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:12.672233 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-03f94417-cd0e-4f8d-8a9c-30c1b3640e5e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.229465 May 19 13:55:12.672965 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 91/179] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:12 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:12.677947 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-17ab1fdb-d50a-49e2-8822-478745166416 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.229018 May 19 13:55:12.678496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 89/180] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:12 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:12.746481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f07e018a-252c-4686-b0cd-6a1d1eb83ee9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:12.749194 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f07e018a-252c-4686-b0cd-6a1d1eb83ee9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:12.756085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f07e018a-252c-4686-b0cd-6a1d1eb83ee9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:12.756769 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f07e018a-252c-4686-b0cd-6a1d1eb83ee9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:12.757452 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f07e018a-252c-4686-b0cd-6a1d1eb83ee9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:12.758038 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f07e018a-252c-4686-b0cd-6a1d1eb83ee9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:12.897561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f07e018a-252c-4686-b0cd-6a1d1eb83ee9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:12.906466 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f07e018a-252c-4686-b0cd-6a1d1eb83ee9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.164925 May 19 13:55:12.916129 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 92/181] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:12 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:13.461794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:13.462413 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:13.466727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4defaccf-3181-400f-997b-a6169966cea2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:13.467510 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4defaccf-3181-400f-997b-a6169966cea2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:13.469190 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.469653 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:13.471069 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.471662 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:13.473465 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4defaccf-3181-400f-997b-a6169966cea2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.473903 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4defaccf-3181-400f-997b-a6169966cea2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:13.474658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4defaccf-3181-400f-997b-a6169966cea2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.475487 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4defaccf-3181-400f-997b-a6169966cea2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:13.687005 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:13.691566 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4defaccf-3181-400f-997b-a6169966cea2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:13.695982 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:13.697581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:13.698769 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-61228ebd-8b56-479c-bff5-c15311feae2b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.241163 May 19 13:55:13.699428 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 90/182] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:13 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:13.699918 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4defaccf-3181-400f-997b-a6169966cea2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.238357 May 19 13:55:13.701535 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 93/183] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:13 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:13.705820 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0f8812b2-0090-4293-b657-c00929684a13 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:13.706220 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bf7447b7-9973-401c-b43e-d6eab802925e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:13.706836 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bf7447b7-9973-401c-b43e-d6eab802925e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:13.707164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0f8812b2-0090-4293-b657-c00929684a13 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:13.714577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bf7447b7-9973-401c-b43e-d6eab802925e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.714734 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f8812b2-0090-4293-b657-c00929684a13 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.715189 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bf7447b7-9973-401c-b43e-d6eab802925e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:13.715319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f8812b2-0090-4293-b657-c00929684a13 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:13.716168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bf7447b7-9973-401c-b43e-d6eab802925e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.716766 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bf7447b7-9973-401c-b43e-d6eab802925e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:13.717109 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f8812b2-0090-4293-b657-c00929684a13 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.717684 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f8812b2-0090-4293-b657-c00929684a13 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:13.911054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bf7447b7-9973-401c-b43e-d6eab802925e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:13.919590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bf7447b7-9973-401c-b43e-d6eab802925e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.216749 May 19 13:55:13.920331 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 94/184] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:13 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:13.923450 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0f8812b2-0090-4293-b657-c00929684a13 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:13.931352 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0f8812b2-0090-4293-b657-c00929684a13 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.228766 May 19 13:55:13.941076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-094b694d-abdc-49e4-8a56-f9bf5834afb5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:13.941183 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 91/185] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:13 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:13.941272 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-094b694d-abdc-49e4-8a56-f9bf5834afb5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:13.941272 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-094b694d-abdc-49e4-8a56-f9bf5834afb5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.941272 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-094b694d-abdc-49e4-8a56-f9bf5834afb5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:13.941272 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-094b694d-abdc-49e4-8a56-f9bf5834afb5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:13.941858 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-094b694d-abdc-49e4-8a56-f9bf5834afb5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:14.071978 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-094b694d-abdc-49e4-8a56-f9bf5834afb5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:14.080532 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-094b694d-abdc-49e4-8a56-f9bf5834afb5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.158839 May 19 13:55:14.081191 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 95/186] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:13 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:14.716914 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c3fa03bb-c4de-43e3-809c-d99350e328e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:14.717415 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:14.717868 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c3fa03bb-c4de-43e3-809c-d99350e328e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:14.717954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:14.723517 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c3fa03bb-c4de-43e3-809c-d99350e328e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:14.723966 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c3fa03bb-c4de-43e3-809c-d99350e328e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:14.724397 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:14.724794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c3fa03bb-c4de-43e3-809c-d99350e328e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:14.724900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:14.725260 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c3fa03bb-c4de-43e3-809c-d99350e328e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:14.725748 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:14.726187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:14.923525 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:14.927901 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c3fa03bb-c4de-43e3-809c-d99350e328e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:14.933635 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:14.936445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:14.936919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c3fa03bb-c4de-43e3-809c-d99350e328e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.224038 May 19 13:55:14.937641 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-fe46cc5e-6998-4e28-a5cf-be8288e60997 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.224395 May 19 13:55:14.938198 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 96/187] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:14 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:14.942837 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5a8b367e-ffc4-4897-96df-86b215400012 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:14.943634 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5a8b367e-ffc4-4897-96df-86b215400012 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:14.946640 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 92/188] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:14 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:14.951679 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d55388e9-8e68-490b-8aed-9df59d9c3eea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:14.951844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a8b367e-ffc4-4897-96df-86b215400012 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:14.952271 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a8b367e-ffc4-4897-96df-86b215400012 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:14.952510 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d55388e9-8e68-490b-8aed-9df59d9c3eea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:14.953037 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a8b367e-ffc4-4897-96df-86b215400012 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:14.953475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a8b367e-ffc4-4897-96df-86b215400012 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:14.958786 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d55388e9-8e68-490b-8aed-9df59d9c3eea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:14.959452 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d55388e9-8e68-490b-8aed-9df59d9c3eea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:14.960213 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d55388e9-8e68-490b-8aed-9df59d9c3eea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:14.960643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d55388e9-8e68-490b-8aed-9df59d9c3eea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:15.163817 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d55388e9-8e68-490b-8aed-9df59d9c3eea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:15.166848 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5a8b367e-ffc4-4897-96df-86b215400012 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:15.177361 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d55388e9-8e68-490b-8aed-9df59d9c3eea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.229563 May 19 13:55:15.177926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 93/189] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:14 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:15.186962 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5a8b367e-ffc4-4897-96df-86b215400012 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.243132 May 19 13:55:15.186962 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 97/190] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:14 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:15.198551 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c9fc593c-b89f-4059-865b-3e6a724cea8d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:15.199864 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c9fc593c-b89f-4059-865b-3e6a724cea8d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:15.207706 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9fc593c-b89f-4059-865b-3e6a724cea8d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:15.208150 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9fc593c-b89f-4059-865b-3e6a724cea8d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:15.208902 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9fc593c-b89f-4059-865b-3e6a724cea8d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:15.209493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9fc593c-b89f-4059-865b-3e6a724cea8d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:15.337776 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c9fc593c-b89f-4059-865b-3e6a724cea8d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:15.345455 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c9fc593c-b89f-4059-865b-3e6a724cea8d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.161572 May 19 13:55:15.346018 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 94/191] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:15 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:15.953309 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d338618c-3660-44f7-8538-bc8430cb9c7e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:15.953959 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d338618c-3660-44f7-8538-bc8430cb9c7e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:15.956578 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:15.957208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:15.960529 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d338618c-3660-44f7-8538-bc8430cb9c7e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:15.960971 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d338618c-3660-44f7-8538-bc8430cb9c7e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:15.961726 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d338618c-3660-44f7-8538-bc8430cb9c7e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:15.962155 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d338618c-3660-44f7-8538-bc8430cb9c7e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:15.963357 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:15.965082 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:15.965872 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:15.966319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:16.158987 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d338618c-3660-44f7-8538-bc8430cb9c7e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:16.166796 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d338618c-3660-44f7-8538-bc8430cb9c7e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.217473 May 19 13:55:16.167401 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 98/192] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:15 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:16.171617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:16.179869 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:16.181450 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:16.182712 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0cdaee12-5776-4954-8f97-98e83e80dfea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.231109 May 19 13:55:16.183296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 95/193] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:15 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:55:16.194950 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f4bcb6b3-adaf-4d2e-8c16-4b05f5b94ef3 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:16.195639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f4bcb6b3-adaf-4d2e-8c16-4b05f5b94ef3 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:16.200665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e7d3b9bb-6f33-41da-a4ee-4b2d2e4dca1f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:16.201356 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e7d3b9bb-6f33-41da-a4ee-4b2d2e4dca1f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:16.205722 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f4bcb6b3-adaf-4d2e-8c16-4b05f5b94ef3 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:16.206102 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f4bcb6b3-adaf-4d2e-8c16-4b05f5b94ef3 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:16.206895 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f4bcb6b3-adaf-4d2e-8c16-4b05f5b94ef3 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:16.207341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f4bcb6b3-adaf-4d2e-8c16-4b05f5b94ef3 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:16.208182 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7d3b9bb-6f33-41da-a4ee-4b2d2e4dca1f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:16.208623 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7d3b9bb-6f33-41da-a4ee-4b2d2e4dca1f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:16.209557 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7d3b9bb-6f33-41da-a4ee-4b2d2e4dca1f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:16.209978 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7d3b9bb-6f33-41da-a4ee-4b2d2e4dca1f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:16.403467 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e7d3b9bb-6f33-41da-a4ee-4b2d2e4dca1f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:16.424823 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e7d3b9bb-6f33-41da-a4ee-4b2d2e4dca1f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.227867 May 19 13:55:16.425832 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 96/194] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:16 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:16.431067 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4305b11d-e0d8-4288-a1c6-0fe1f04961dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:16.431931 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4305b11d-e0d8-4288-a1c6-0fe1f04961dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:16.437169 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f4bcb6b3-adaf-4d2e-8c16-4b05f5b94ef3 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:16.439407 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4305b11d-e0d8-4288-a1c6-0fe1f04961dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:16.439920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4305b11d-e0d8-4288-a1c6-0fe1f04961dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:16.440799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4305b11d-e0d8-4288-a1c6-0fe1f04961dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:16.441336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4305b11d-e0d8-4288-a1c6-0fe1f04961dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:16.444703 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f4bcb6b3-adaf-4d2e-8c16-4b05f5b94ef3 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.255176 May 19 13:55:16.445273 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 99/195] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:16 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:16.587182 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4305b11d-e0d8-4288-a1c6-0fe1f04961dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:16.595863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4305b11d-e0d8-4288-a1c6-0fe1f04961dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.168861 May 19 13:55:16.596458 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 97/196] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:16 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:17.184049 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ceed76bd-21e2-49e2-8076-d306789cd68d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:17.184650 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ceed76bd-21e2-49e2-8076-d306789cd68d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:17.191524 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ceed76bd-21e2-49e2-8076-d306789cd68d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.191965 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ceed76bd-21e2-49e2-8076-d306789cd68d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.192804 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ceed76bd-21e2-49e2-8076-d306789cd68d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.193301 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ceed76bd-21e2-49e2-8076-d306789cd68d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.201993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:17.202836 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:17.208832 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.209283 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.210043 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.210474 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.389907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ceed76bd-21e2-49e2-8076-d306789cd68d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:17.394309 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:17.397711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ceed76bd-21e2-49e2-8076-d306789cd68d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.217443 May 19 13:55:17.398285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 100/197] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:17 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:17.402773 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:17.404331 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:17.406085 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-174850ca-2d3c-4aa5-85f7-54edd1610d54 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.209262 May 19 13:55:17.406625 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 98/198] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:17 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:55:17.441878 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c8b7cacc-98ba-4b1e-9765-77a974e4a4bc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:17.442480 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c8b7cacc-98ba-4b1e-9765-77a974e4a4bc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:17.448422 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c8b7cacc-98ba-4b1e-9765-77a974e4a4bc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.448858 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c8b7cacc-98ba-4b1e-9765-77a974e4a4bc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.449600 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c8b7cacc-98ba-4b1e-9765-77a974e4a4bc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.450026 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c8b7cacc-98ba-4b1e-9765-77a974e4a4bc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.453418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:17.461743 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b195048f-fa19-4ebf-9267-90915e123960 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:17.462383 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b195048f-fa19-4ebf-9267-90915e123960 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:17.468784 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b195048f-fa19-4ebf-9267-90915e123960 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.469237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b195048f-fa19-4ebf-9267-90915e123960 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.469997 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b195048f-fa19-4ebf-9267-90915e123960 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.470432 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b195048f-fa19-4ebf-9267-90915e123960 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.634158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c8b7cacc-98ba-4b1e-9765-77a974e4a4bc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:17.642821 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c8b7cacc-98ba-4b1e-9765-77a974e4a4bc tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.204631 May 19 13:55:17.643421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 101/199] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:17 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:17.650783 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b195048f-fa19-4ebf-9267-90915e123960 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:17.653190 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-78a35fc9-b783-4025-948f-556c12649307 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:17.653795 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-78a35fc9-b783-4025-948f-556c12649307 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:17.658971 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b195048f-fa19-4ebf-9267-90915e123960 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.200898 May 19 13:55:17.659551 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 99/200] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:17 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:17.659989 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-78a35fc9-b783-4025-948f-556c12649307 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.660441 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-78a35fc9-b783-4025-948f-556c12649307 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.661235 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-78a35fc9-b783-4025-948f-556c12649307 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:17.661665 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-78a35fc9-b783-4025-948f-556c12649307 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:17.799029 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-78a35fc9-b783-4025-948f-556c12649307 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:17.806471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-78a35fc9-b783-4025-948f-556c12649307 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.157221 May 19 13:55:17.806991 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 102/201] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:17 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:18.414364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8111a7f8-b42e-4695-bb26-cfb7ba936c20 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:18.415021 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8111a7f8-b42e-4695-bb26-cfb7ba936c20 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:18.421470 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8111a7f8-b42e-4695-bb26-cfb7ba936c20 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:18.421924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8111a7f8-b42e-4695-bb26-cfb7ba936c20 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:18.422754 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8111a7f8-b42e-4695-bb26-cfb7ba936c20 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:18.423290 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8111a7f8-b42e-4695-bb26-cfb7ba936c20 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:18.425234 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:18.426556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:18.433165 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:18.433747 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:18.434517 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:18.435222 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:18.438979 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=100 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:18.624968 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8111a7f8-b42e-4695-bb26-cfb7ba936c20 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:18.633720 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8111a7f8-b42e-4695-bb26-cfb7ba936c20 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.223044 May 19 13:55:18.634283 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 100/202] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:18 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:18.640902 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:18.649466 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:18.650990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:18.652085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bebe7e2c-dc88-4710-9073-847bb5380fc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.231725 May 19 13:55:18.652634 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 103/203] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:18 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:55:18.659478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5921da77-9333-4632-8499-0d183b1e60bb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:18.660312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5921da77-9333-4632-8499-0d183b1e60bb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:18.666718 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5921da77-9333-4632-8499-0d183b1e60bb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:18.667214 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5921da77-9333-4632-8499-0d183b1e60bb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:18.668324 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5921da77-9333-4632-8499-0d183b1e60bb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:18.668759 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5921da77-9333-4632-8499-0d183b1e60bb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:18.677123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-118a2135-dcb8-4760-bce5-edb2db2c3f63 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:18.677969 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-118a2135-dcb8-4760-bce5-edb2db2c3f63 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:18.686952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-118a2135-dcb8-4760-bce5-edb2db2c3f63 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:18.691439 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-118a2135-dcb8-4760-bce5-edb2db2c3f63 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:18.692416 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-118a2135-dcb8-4760-bce5-edb2db2c3f63 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:18.692991 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-118a2135-dcb8-4760-bce5-edb2db2c3f63 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:19.036087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5921da77-9333-4632-8499-0d183b1e60bb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:19.048844 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5921da77-9333-4632-8499-0d183b1e60bb tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.392876 May 19 13:55:19.050297 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 101/204] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:18 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:19.058127 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-84999356-2370-4c80-aa51-d09a7dd5e777 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:19.058737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-84999356-2370-4c80-aa51-d09a7dd5e777 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:19.081977 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84999356-2370-4c80-aa51-d09a7dd5e777 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:19.082438 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84999356-2370-4c80-aa51-d09a7dd5e777 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:19.083259 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84999356-2370-4c80-aa51-d09a7dd5e777 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:19.083697 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84999356-2370-4c80-aa51-d09a7dd5e777 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:19.114754 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-118a2135-dcb8-4760-bce5-edb2db2c3f63 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:19.124129 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-118a2135-dcb8-4760-bce5-edb2db2c3f63 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.449780 May 19 13:55:19.124895 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 104/205] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:18 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:19.553799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-84999356-2370-4c80-aa51-d09a7dd5e777 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:19.562728 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-84999356-2370-4c80-aa51-d09a7dd5e777 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.510705 May 19 13:55:19.563350 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 102/206] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:19 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:19.649993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-44088cac-4032-4832-8f64-002bd2ea335d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:19.650759 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-44088cac-4032-4832-8f64-002bd2ea335d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:19.658939 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-44088cac-4032-4832-8f64-002bd2ea335d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:19.659482 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-44088cac-4032-4832-8f64-002bd2ea335d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:19.660294 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-44088cac-4032-4832-8f64-002bd2ea335d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:19.660786 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-44088cac-4032-4832-8f64-002bd2ea335d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:19.669706 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:19.671029 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:19.677473 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:19.677930 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:19.678886 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:19.679343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:19.887431 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-44088cac-4032-4832-8f64-002bd2ea335d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:19.895175 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-44088cac-4032-4832-8f64-002bd2ea335d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.249049 May 19 13:55:19.903961 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:19.904956 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 105/207] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:19 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:19.914951 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:19.916644 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:19.918375 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-269ea67c-8a7e-447e-b8df-3829eae59e34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.252726 May 19 13:55:19.919141 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 103/208] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:19 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:20.066810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5e8e5d15-d9fd-41e7-9e9c-9081e0594d7d tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:20.067553 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5e8e5d15-d9fd-41e7-9e9c-9081e0594d7d tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:20.073482 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5e8e5d15-d9fd-41e7-9e9c-9081e0594d7d tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.073998 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5e8e5d15-d9fd-41e7-9e9c-9081e0594d7d tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:20.074820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5e8e5d15-d9fd-41e7-9e9c-9081e0594d7d tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.075344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5e8e5d15-d9fd-41e7-9e9c-9081e0594d7d tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:20.141442 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2e554312-a03d-4651-a3aa-55e42a927f57 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:20.142053 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2e554312-a03d-4651-a3aa-55e42a927f57 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:20.149408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e554312-a03d-4651-a3aa-55e42a927f57 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.149831 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e554312-a03d-4651-a3aa-55e42a927f57 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:20.150592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e554312-a03d-4651-a3aa-55e42a927f57 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.151045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e554312-a03d-4651-a3aa-55e42a927f57 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:20.286994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5e8e5d15-d9fd-41e7-9e9c-9081e0594d7d tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:20.297334 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5e8e5d15-d9fd-41e7-9e9c-9081e0594d7d tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1315 microversion: 2.1 time: 0.232946 May 19 13:55:20.313751 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 106/209] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:20 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:20.352937 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e554312-a03d-4651-a3aa-55e42a927f57 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:20.367267 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2e554312-a03d-4651-a3aa-55e42a927f57 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.229595 May 19 13:55:20.368026 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 104/210] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:20 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:20.583985 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9acfdb43-1a3c-4520-a6bf-abc05502dddb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:20.585551 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9acfdb43-1a3c-4520-a6bf-abc05502dddb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:20.595044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9acfdb43-1a3c-4520-a6bf-abc05502dddb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.597917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9acfdb43-1a3c-4520-a6bf-abc05502dddb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:20.598956 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9acfdb43-1a3c-4520-a6bf-abc05502dddb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.599594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9acfdb43-1a3c-4520-a6bf-abc05502dddb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:20.768293 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9acfdb43-1a3c-4520-a6bf-abc05502dddb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:20.776477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9acfdb43-1a3c-4520-a6bf-abc05502dddb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.200831 May 19 13:55:20.777041 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 107/211] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:20 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:20.920430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-de6c9d63-8bb2-4028-93a6-601129ca76d0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:20.921208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-de6c9d63-8bb2-4028-93a6-601129ca76d0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:20.933458 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de6c9d63-8bb2-4028-93a6-601129ca76d0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.934026 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de6c9d63-8bb2-4028-93a6-601129ca76d0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:20.935197 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de6c9d63-8bb2-4028-93a6-601129ca76d0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.935850 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de6c9d63-8bb2-4028-93a6-601129ca76d0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:20.940487 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:20.941423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:20.954075 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.954525 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:20.956743 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:20.957406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:21.148283 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-de6c9d63-8bb2-4028-93a6-601129ca76d0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:21.153990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:21.163826 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:21.164039 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-de6c9d63-8bb2-4028-93a6-601129ca76d0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.255742 May 19 13:55:21.164727 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 105/212] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:20 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:21.167613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:21.168740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a5c67fec-0df7-40db-b4ae-086f60122125 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.234218 May 19 13:55:21.169296 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 108/213] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:20 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:21.324897 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-08ece185-b51e-4703-bd83-9575e739623e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:21.326508 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-08ece185-b51e-4703-bd83-9575e739623e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:21.344099 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08ece185-b51e-4703-bd83-9575e739623e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:21.344988 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08ece185-b51e-4703-bd83-9575e739623e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:21.347638 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08ece185-b51e-4703-bd83-9575e739623e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:21.349543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08ece185-b51e-4703-bd83-9575e739623e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:21.409333 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7e03afc9-72c9-40be-8b58-b53e279c24a4 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:21.419156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7e03afc9-72c9-40be-8b58-b53e279c24a4 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:21.445499 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e03afc9-72c9-40be-8b58-b53e279c24a4 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:21.445947 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e03afc9-72c9-40be-8b58-b53e279c24a4 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:21.451152 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e03afc9-72c9-40be-8b58-b53e279c24a4 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:21.451844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e03afc9-72c9-40be-8b58-b53e279c24a4 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:21.817219 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-08ece185-b51e-4703-bd83-9575e739623e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:21.825788 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-08ece185-b51e-4703-bd83-9575e739623e tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1502 microversion: 2.1 time: 0.514795 May 19 13:55:21.829828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7e03afc9-72c9-40be-8b58-b53e279c24a4 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:21.839884 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7e03afc9-72c9-40be-8b58-b53e279c24a4 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.457008 May 19 13:55:21.840666 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 109/214] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:21 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:21.844093 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 106/215] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:21 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1502 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:21.850183 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8b11d9c5-5c25-46d9-8ca5-adffb5f55c46 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:21.853170 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8b11d9c5-5c25-46d9-8ca5-adffb5f55c46 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:21.862260 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8b11d9c5-5c25-46d9-8ca5-adffb5f55c46 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:21.863401 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8b11d9c5-5c25-46d9-8ca5-adffb5f55c46 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:21.864550 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8b11d9c5-5c25-46d9-8ca5-adffb5f55c46 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:21.865179 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8b11d9c5-5c25-46d9-8ca5-adffb5f55c46 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:21.871979 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-1d002c12-5837-4cee-97bb-04b9cdda2315 req-708457d9-c432-4fd0-a747-2fad4c28e12d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e2c2f-4753-4911-8859-73736543f959", "name": "network-vif-plugged", "status": "completed", "tag": "5e326997-1358-457a-8426-4184a94bfdad"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:21.894830 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-1d002c12-5837-4cee-97bb-04b9cdda2315 req-708457d9-c432-4fd0-a747-2fad4c28e12d service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:21.894830 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-1d002c12-5837-4cee-97bb-04b9cdda2315 req-708457d9-c432-4fd0-a747-2fad4c28e12d service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:21.912385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-1d002c12-5837-4cee-97bb-04b9cdda2315 req-708457d9-c432-4fd0-a747-2fad4c28e12d service nova] Creating event network-vif-plugged:5e326997-1358-457a-8426-4184a94bfdad for instance 5c4e2c2f-4753-4911-8859-73736543f959 on hv-cinder-78481 May 19 13:55:21.929551 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-1d002c12-5837-4cee-97bb-04b9cdda2315 req-708457d9-c432-4fd0-a747-2fad4c28e12d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086551 May 19 13:55:21.931566 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 110/216] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:22.102691 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8b11d9c5-5c25-46d9-8ca5-adffb5f55c46 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:22.111229 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8b11d9c5-5c25-46d9-8ca5-adffb5f55c46 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.265749 May 19 13:55:22.121123 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 107/217] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:21 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:22.191295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5cb679db-5147-497b-9fe7-d8950207a255 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:22.191758 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:22.193116 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:22.194657 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5cb679db-5147-497b-9fe7-d8950207a255 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:22.210756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5cb679db-5147-497b-9fe7-d8950207a255 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:22.212387 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:22.212985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:22.213518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5cb679db-5147-497b-9fe7-d8950207a255 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:22.214667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:22.215118 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:22.216675 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5cb679db-5147-497b-9fe7-d8950207a255 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:22.217299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5cb679db-5147-497b-9fe7-d8950207a255 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:22.573749 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:22.589071 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:22.598016 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:22.599658 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cb4bfd5b-208d-4bf4-b632-06552ce48892 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.415414 May 19 13:55:22.613754 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 108/218] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:22 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:22.620908 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5cb679db-5147-497b-9fe7-d8950207a255 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:22.654279 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5cb679db-5147-497b-9fe7-d8950207a255 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.476102 May 19 13:55:22.660447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 111/219] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:22 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:22.857987 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f285bdef-57d4-4634-ba84-5c655a0b56b0 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:22.859072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f285bdef-57d4-4634-ba84-5c655a0b56b0 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:22.872599 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f285bdef-57d4-4634-ba84-5c655a0b56b0 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:22.874048 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f285bdef-57d4-4634-ba84-5c655a0b56b0 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:22.875811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f285bdef-57d4-4634-ba84-5c655a0b56b0 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:22.876721 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f285bdef-57d4-4634-ba84-5c655a0b56b0 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:23.104594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f285bdef-57d4-4634-ba84-5c655a0b56b0 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:23.114106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f285bdef-57d4-4634-ba84-5c655a0b56b0 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.260506 May 19 13:55:23.114682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 109/220] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:22 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:23.129972 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b7034528-05d6-405e-beb7-5bc9cec34cd6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:23.131794 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b7034528-05d6-405e-beb7-5bc9cec34cd6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:23.139927 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b7034528-05d6-405e-beb7-5bc9cec34cd6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:23.140394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b7034528-05d6-405e-beb7-5bc9cec34cd6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:23.141138 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b7034528-05d6-405e-beb7-5bc9cec34cd6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:23.141567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b7034528-05d6-405e-beb7-5bc9cec34cd6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:23.307599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b7034528-05d6-405e-beb7-5bc9cec34cd6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:23.316316 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b7034528-05d6-405e-beb7-5bc9cec34cd6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.191014 May 19 13:55:23.316997 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 112/221] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:23 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:23.397731 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7e689fc0-2d02-4e5d-8f7f-42acdfe0a3f4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6246862-360f-4e43-9f2e-2a1e7313e25b"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:23.405021 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7e689fc0-2d02-4e5d-8f7f-42acdfe0a3f4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:23.411826 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e689fc0-2d02-4e5d-8f7f-42acdfe0a3f4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:23.412414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e689fc0-2d02-4e5d-8f7f-42acdfe0a3f4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:23.413466 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e689fc0-2d02-4e5d-8f7f-42acdfe0a3f4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:23.414169 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e689fc0-2d02-4e5d-8f7f-42acdfe0a3f4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:23.620283 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:23.621093 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:23.651291 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:23.651746 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:23.652539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:23.652974 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:23.930599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:23.944434 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:23.946345 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:23.956166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-04ea2fd8-53a3-4b99-acbf-ddce3fd75f92 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.331954 May 19 13:55:23.961492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 113/222] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:23 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:23.991096 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1ef6215a-39ba-4ee1-b3aa-aa7376d5fcf4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:23.991913 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1ef6215a-39ba-4ee1-b3aa-aa7376d5fcf4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:24.010283 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1ef6215a-39ba-4ee1-b3aa-aa7376d5fcf4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:24.011578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1ef6215a-39ba-4ee1-b3aa-aa7376d5fcf4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:24.012564 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1ef6215a-39ba-4ee1-b3aa-aa7376d5fcf4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:24.014911 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1ef6215a-39ba-4ee1-b3aa-aa7376d5fcf4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:24.412399 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7e689fc0-2d02-4e5d-8f7f-42acdfe0a3f4 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "POST /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021542 May 19 13:55:24.413100 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 110/223] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 13:55:23 2022] POST /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097/os-volume_attachments => generated 194 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:24.426645 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1ef6215a-39ba-4ee1-b3aa-aa7376d5fcf4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:24.440854 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1ef6215a-39ba-4ee1-b3aa-aa7376d5fcf4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.476515 May 19 13:55:24.441634 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 114/224] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:23 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:24.447117 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1004898e-b5d9-464a-9a19-ba6f8495dc5f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:24.448167 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1004898e-b5d9-464a-9a19-ba6f8495dc5f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:24.452146 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e6d48d0f-5c29-4180-9bbd-6e77fec99a3a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:24.455582 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e6d48d0f-5c29-4180-9bbd-6e77fec99a3a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:24.456194 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1004898e-b5d9-464a-9a19-ba6f8495dc5f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:24.456780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1004898e-b5d9-464a-9a19-ba6f8495dc5f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:24.457685 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1004898e-b5d9-464a-9a19-ba6f8495dc5f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:24.458292 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1004898e-b5d9-464a-9a19-ba6f8495dc5f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:24.483732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e6d48d0f-5c29-4180-9bbd-6e77fec99a3a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:24.487109 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e6d48d0f-5c29-4180-9bbd-6e77fec99a3a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:24.490014 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e6d48d0f-5c29-4180-9bbd-6e77fec99a3a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:24.490566 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e6d48d0f-5c29-4180-9bbd-6e77fec99a3a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:24.699294 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1004898e-b5d9-464a-9a19-ba6f8495dc5f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:24.710797 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1004898e-b5d9-464a-9a19-ba6f8495dc5f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.267588 May 19 13:55:24.714424 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 115/225] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:24 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:24.763144 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e6d48d0f-5c29-4180-9bbd-6e77fec99a3a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:24.772789 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e6d48d0f-5c29-4180-9bbd-6e77fec99a3a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.358016 May 19 13:55:24.773489 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 111/226] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:24 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:24.984909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:24.989538 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:25.000954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:25.001763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:25.002728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:25.004026 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:25.179198 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:25.197015 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:25.202079 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:25.204431 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2b6584de-123e-4ca6-9a64-9428c94576da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1406 microversion: 2.20 time: 0.227026 May 19 13:55:25.205782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 116/227] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:24 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:25.457787 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e303011c-2d44-442e-a8f4-8e302a4dead2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:25.458614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e303011c-2d44-442e-a8f4-8e302a4dead2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:25.465529 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e303011c-2d44-442e-a8f4-8e302a4dead2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:25.466118 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e303011c-2d44-442e-a8f4-8e302a4dead2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:25.467525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e303011c-2d44-442e-a8f4-8e302a4dead2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:25.467750 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e303011c-2d44-442e-a8f4-8e302a4dead2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:25.635236 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e303011c-2d44-442e-a8f4-8e302a4dead2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:25.644135 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e303011c-2d44-442e-a8f4-8e302a4dead2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.190298 May 19 13:55:25.644760 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 112/228] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:25 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:25.731064 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9a4673d1-55b2-4384-9e3f-4543d9d9e301 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:25.732440 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9a4673d1-55b2-4384-9e3f-4543d9d9e301 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:25.740409 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9a4673d1-55b2-4384-9e3f-4543d9d9e301 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:25.741087 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9a4673d1-55b2-4384-9e3f-4543d9d9e301 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:25.742682 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9a4673d1-55b2-4384-9e3f-4543d9d9e301 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:25.743312 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9a4673d1-55b2-4384-9e3f-4543d9d9e301 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:25.794453 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cb58b2d5-15cd-4a66-963a-3bf52459a5a1 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:25.797296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cb58b2d5-15cd-4a66-963a-3bf52459a5a1 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:25.804228 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb58b2d5-15cd-4a66-963a-3bf52459a5a1 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:25.804828 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb58b2d5-15cd-4a66-963a-3bf52459a5a1 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:25.805742 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb58b2d5-15cd-4a66-963a-3bf52459a5a1 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:25.806164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb58b2d5-15cd-4a66-963a-3bf52459a5a1 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:25.935957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9a4673d1-55b2-4384-9e3f-4543d9d9e301 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:25.945756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9a4673d1-55b2-4384-9e3f-4543d9d9e301 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.218109 May 19 13:55:25.946693 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 117/229] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:25 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:25.986596 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cb58b2d5-15cd-4a66-963a-3bf52459a5a1 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:25.994127 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cb58b2d5-15cd-4a66-963a-3bf52459a5a1 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.206972 May 19 13:55:25.994895 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 113/230] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:25 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:26.223399 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:26.224136 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:26.231010 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:26.231558 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:26.232681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:26.233356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:26.249935 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:26.393350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:26.403221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:26.405823 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:26.407226 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-aa53926d-7ed7-4d40-afb8-b7f00bd79209 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1597 microversion: 2.20 time: 0.187633 May 19 13:55:26.422002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 118/231] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:55:26 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1597 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:55:26.428853 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3b800111-3786-4295-a82b-90e63875c9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:26.429353 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3b800111-3786-4295-a82b-90e63875c9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:26.438038 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b800111-3786-4295-a82b-90e63875c9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:26.438513 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b800111-3786-4295-a82b-90e63875c9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:26.439362 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b800111-3786-4295-a82b-90e63875c9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:26.440138 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b800111-3786-4295-a82b-90e63875c9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:26.540039 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3b800111-3786-4295-a82b-90e63875c9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.116189 May 19 13:55:26.540914 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 114/232] 10.222.0.52 () {60 vars in 1315 bytes} [Thu May 19 13:55:26 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:55:26.664136 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-853289e3-9202-4205-a02c-5acd785e3dcb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:26.665333 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-853289e3-9202-4205-a02c-5acd785e3dcb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:26.687558 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-853289e3-9202-4205-a02c-5acd785e3dcb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:26.688019 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-853289e3-9202-4205-a02c-5acd785e3dcb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:26.688813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-853289e3-9202-4205-a02c-5acd785e3dcb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:26.689257 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-853289e3-9202-4205-a02c-5acd785e3dcb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:26.934119 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-adfb78e4-dde1-409c-877f-b18c39c201e0 req-e359fd54-83a1-42e8-8f18-ae8d6d54a799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e425ccc-4508-4267-bc69-5590c1f503ec", "name": "network-vif-plugged", "status": "completed", "tag": "a4da582a-6527-48e4-b52c-7d888d7e053a"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:26.939800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=100 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:26.964447 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-adfb78e4-dde1-409c-877f-b18c39c201e0 req-e359fd54-83a1-42e8-8f18-ae8d6d54a799 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:26.965684 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-adfb78e4-dde1-409c-877f-b18c39c201e0 req-e359fd54-83a1-42e8-8f18-ae8d6d54a799 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:27.027866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-adfb78e4-dde1-409c-877f-b18c39c201e0 req-e359fd54-83a1-42e8-8f18-ae8d6d54a799 service nova] Creating event network-vif-plugged:a4da582a-6527-48e4-b52c-7d888d7e053a for instance 2e425ccc-4508-4267-bc69-5590c1f503ec on hv-cinder-78481 May 19 13:55:27.046273 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-adfb78e4-dde1-409c-877f-b18c39c201e0 req-e359fd54-83a1-42e8-8f18-ae8d6d54a799 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113653 May 19 13:55:27.049470 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 115/233] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:55:27.058693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5a477e06-f354-4073-9565-0bfa783a04ef tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:27.059767 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5a477e06-f354-4073-9565-0bfa783a04ef tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:27.067770 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a477e06-f354-4073-9565-0bfa783a04ef tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:27.068445 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a477e06-f354-4073-9565-0bfa783a04ef tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:27.069498 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a477e06-f354-4073-9565-0bfa783a04ef tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:27.070092 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a477e06-f354-4073-9565-0bfa783a04ef tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:27.150435 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-853289e3-9202-4205-a02c-5acd785e3dcb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:27.168766 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-853289e3-9202-4205-a02c-5acd785e3dcb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.511200 May 19 13:55:27.170479 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 119/234] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:26 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:27.188912 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-40ed42c5-35aa-4de7-98a5-a44e49b307ba tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:27.193108 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-40ed42c5-35aa-4de7-98a5-a44e49b307ba tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:27.212187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40ed42c5-35aa-4de7-98a5-a44e49b307ba tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:27.218894 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40ed42c5-35aa-4de7-98a5-a44e49b307ba tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:27.220462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40ed42c5-35aa-4de7-98a5-a44e49b307ba tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:27.221961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40ed42c5-35aa-4de7-98a5-a44e49b307ba tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:27.396566 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5a477e06-f354-4073-9565-0bfa783a04ef tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:27.399161 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:27.406243 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5a477e06-f354-4073-9565-0bfa783a04ef tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.355366 May 19 13:55:27.413022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 116/235] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:27 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:27.733643 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-40ed42c5-35aa-4de7-98a5-a44e49b307ba tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:27.751240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-40ed42c5-35aa-4de7-98a5-a44e49b307ba tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.579116 May 19 13:55:27.760929 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 120/236] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:27 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:28.187974 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d59af29b-b44a-4216-8a70-8f4539e3a5cb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:28.188587 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d59af29b-b44a-4216-8a70-8f4539e3a5cb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:28.204959 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d59af29b-b44a-4216-8a70-8f4539e3a5cb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:28.205451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d59af29b-b44a-4216-8a70-8f4539e3a5cb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:28.206242 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d59af29b-b44a-4216-8a70-8f4539e3a5cb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:28.206703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d59af29b-b44a-4216-8a70-8f4539e3a5cb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:28.428513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-33d037ab-df41-4e74-87bd-30e134ffb93b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:28.429149 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-33d037ab-df41-4e74-87bd-30e134ffb93b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:28.443331 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:28.450715 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33d037ab-df41-4e74-87bd-30e134ffb93b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:28.450715 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33d037ab-df41-4e74-87bd-30e134ffb93b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:28.454163 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33d037ab-df41-4e74-87bd-30e134ffb93b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:28.457469 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33d037ab-df41-4e74-87bd-30e134ffb93b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:28.507677 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d59af29b-b44a-4216-8a70-8f4539e3a5cb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:28.525345 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d59af29b-b44a-4216-8a70-8f4539e3a5cb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.342117 May 19 13:55:28.525965 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 117/237] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:28 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:28.624896 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-e83a02a8-d368-4f83-8ff0-a09b4e8c10d1 req-1a303395-d126-4eb4-b6f1-68e9385edef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c4e2c2f-4753-4911-8859-73736543f959", "tag": "5e326997-1358-457a-8426-4184a94bfdad"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:28.663919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-e83a02a8-d368-4f83-8ff0-a09b4e8c10d1 req-1a303395-d126-4eb4-b6f1-68e9385edef5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:28.664359 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-e83a02a8-d368-4f83-8ff0-a09b4e8c10d1 req-1a303395-d126-4eb4-b6f1-68e9385edef5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:28.682777 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-33d037ab-df41-4e74-87bd-30e134ffb93b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:28.692264 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-33d037ab-df41-4e74-87bd-30e134ffb93b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.267403 May 19 13:55:28.693441 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 121/238] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:28 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:28.696126 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-e83a02a8-d368-4f83-8ff0-a09b4e8c10d1 req-1a303395-d126-4eb4-b6f1-68e9385edef5 service nova] Creating event network-changed:5e326997-1358-457a-8426-4184a94bfdad for instance 5c4e2c2f-4753-4911-8859-73736543f959 on hv-cinder-78481 May 19 13:55:28.705809 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-e83a02a8-d368-4f83-8ff0-a09b4e8c10d1 req-1a303395-d126-4eb4-b6f1-68e9385edef5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085205 May 19 13:55:28.706417 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 118/239] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:55:28.770960 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-deaec9cc-2c8d-424a-a4ca-5458f6d467fb tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:28.772383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-deaec9cc-2c8d-424a-a4ca-5458f6d467fb tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:28.788793 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-deaec9cc-2c8d-424a-a4ca-5458f6d467fb tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:28.789393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-deaec9cc-2c8d-424a-a4ca-5458f6d467fb tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:28.790332 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-deaec9cc-2c8d-424a-a4ca-5458f6d467fb tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:28.790893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-deaec9cc-2c8d-424a-a4ca-5458f6d467fb tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:29.064075 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-e515e638-2512-42f8-8211-24e2bce38ab5 req-45899aa4-b706-4e6c-8058-f1102f1eb1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fbcca9-a311-4ec9-b2b6-569b9a96e460", "name": "network-vif-plugged", "status": "completed", "tag": "12af5875-0105-4c5e-ab8b-4f48b11e4870"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:29.081341 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-e515e638-2512-42f8-8211-24e2bce38ab5 req-45899aa4-b706-4e6c-8058-f1102f1eb1d8 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:29.082031 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-e515e638-2512-42f8-8211-24e2bce38ab5 req-45899aa4-b706-4e6c-8058-f1102f1eb1d8 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:29.109606 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-e515e638-2512-42f8-8211-24e2bce38ab5 req-45899aa4-b706-4e6c-8058-f1102f1eb1d8 service nova] Creating event network-vif-plugged:12af5875-0105-4c5e-ab8b-4f48b11e4870 for instance 72fbcca9-a311-4ec9-b2b6-569b9a96e460 on hv-cinder-78481 May 19 13:55:29.116485 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-e515e638-2512-42f8-8211-24e2bce38ab5 req-45899aa4-b706-4e6c-8058-f1102f1eb1d8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056498 May 19 13:55:29.117684 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 119/240] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:55:29.276445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-deaec9cc-2c8d-424a-a4ca-5458f6d467fb tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:29.288986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-deaec9cc-2c8d-424a-a4ca-5458f6d467fb tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.521314 May 19 13:55:29.292458 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 122/241] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:28 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:29.546711 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-32f2357b-77e5-400e-b975-baae26037d2e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:29.548090 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-32f2357b-77e5-400e-b975-baae26037d2e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:29.559042 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-32f2357b-77e5-400e-b975-baae26037d2e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:29.559687 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-32f2357b-77e5-400e-b975-baae26037d2e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:29.561522 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-32f2357b-77e5-400e-b975-baae26037d2e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:29.562051 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-32f2357b-77e5-400e-b975-baae26037d2e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:29.711562 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f76b3247-7ae9-40b5-ba54-c8f45d668b55 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:29.712939 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f76b3247-7ae9-40b5-ba54-c8f45d668b55 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:29.727812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f76b3247-7ae9-40b5-ba54-c8f45d668b55 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:29.728700 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f76b3247-7ae9-40b5-ba54-c8f45d668b55 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:29.732471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f76b3247-7ae9-40b5-ba54-c8f45d668b55 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:29.733354 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f76b3247-7ae9-40b5-ba54-c8f45d668b55 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:29.956864 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-32f2357b-77e5-400e-b975-baae26037d2e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:29.965604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-32f2357b-77e5-400e-b975-baae26037d2e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.426950 May 19 13:55:29.966178 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 120/242] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:29 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:30.027252 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f76b3247-7ae9-40b5-ba54-c8f45d668b55 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:30.038344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f76b3247-7ae9-40b5-ba54-c8f45d668b55 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.331810 May 19 13:55:30.040544 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 123/243] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:29 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:30.153399 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1eb3951e-0d48-4d6f-a5d6-9bde64a7b8cd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:30.154921 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1eb3951e-0d48-4d6f-a5d6-9bde64a7b8cd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:30.186913 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1eb3951e-0d48-4d6f-a5d6-9bde64a7b8cd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:30.186913 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1eb3951e-0d48-4d6f-a5d6-9bde64a7b8cd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:30.191224 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1eb3951e-0d48-4d6f-a5d6-9bde64a7b8cd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:30.191689 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1eb3951e-0d48-4d6f-a5d6-9bde64a7b8cd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:30.251997 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1eb3951e-0d48-4d6f-a5d6-9bde64a7b8cd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:55:30.309757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-01fe2ff8-53f8-4d50-b151-9404f277b661 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:30.311002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-01fe2ff8-53f8-4d50-b151-9404f277b661 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:30.319406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-01fe2ff8-53f8-4d50-b151-9404f277b661 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:30.319851 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-01fe2ff8-53f8-4d50-b151-9404f277b661 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:30.320624 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-01fe2ff8-53f8-4d50-b151-9404f277b661 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:30.321698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-01fe2ff8-53f8-4d50-b151-9404f277b661 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:30.409710 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1eb3951e-0d48-4d6f-a5d6-9bde64a7b8cd tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 204 len: 0 microversion: 2.1 time: 0.259596 May 19 13:55:30.411640 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 121/244] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:55:30 2022] DELETE /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:55:30.421934 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-641956d0-8b28-4c7f-93ba-91cf64091614 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:30.423444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-641956d0-8b28-4c7f-93ba-91cf64091614 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:30.433100 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-641956d0-8b28-4c7f-93ba-91cf64091614 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:30.433832 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-641956d0-8b28-4c7f-93ba-91cf64091614 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:30.434986 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-641956d0-8b28-4c7f-93ba-91cf64091614 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:30.436343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-641956d0-8b28-4c7f-93ba-91cf64091614 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:30.747062 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-01fe2ff8-53f8-4d50-b151-9404f277b661 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:30.750144 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-641956d0-8b28-4c7f-93ba-91cf64091614 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:30.757972 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-01fe2ff8-53f8-4d50-b151-9404f277b661 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.452290 May 19 13:55:30.758819 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-641956d0-8b28-4c7f-93ba-91cf64091614 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1554 microversion: 2.1 time: 0.343226 May 19 13:55:30.759732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 122/245] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:30 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1554 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:30.769233 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 124/246] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:30 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:30.987457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c81e4984-d171-471b-ad97-ffad22c95d6e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:30.988069 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c81e4984-d171-471b-ad97-ffad22c95d6e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:30.993907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c81e4984-d171-471b-ad97-ffad22c95d6e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:30.994682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c81e4984-d171-471b-ad97-ffad22c95d6e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:30.995480 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c81e4984-d171-471b-ad97-ffad22c95d6e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:30.995922 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c81e4984-d171-471b-ad97-ffad22c95d6e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:31.060844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f3788f31-fce3-428a-8ecc-de0bbc96980d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:31.061670 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f3788f31-fce3-428a-8ecc-de0bbc96980d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:31.078313 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f3788f31-fce3-428a-8ecc-de0bbc96980d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:31.078770 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f3788f31-fce3-428a-8ecc-de0bbc96980d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:31.079747 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f3788f31-fce3-428a-8ecc-de0bbc96980d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:31.080189 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f3788f31-fce3-428a-8ecc-de0bbc96980d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:31.220928 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c81e4984-d171-471b-ad97-ffad22c95d6e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:31.233288 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c81e4984-d171-471b-ad97-ffad22c95d6e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.248511 May 19 13:55:31.234285 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 123/247] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:30 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:31.277807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f3788f31-fce3-428a-8ecc-de0bbc96980d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:31.286279 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f3788f31-fce3-428a-8ecc-de0bbc96980d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.229161 May 19 13:55:31.286762 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 125/248] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:31 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:31.777710 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bc168669-1b2e-40a7-9ec0-29dc31c71310 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:31.778716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bc168669-1b2e-40a7-9ec0-29dc31c71310 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:31.779846 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-496b2eb8-eff4-40d9-b630-fcd545096f63 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:31.780986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-496b2eb8-eff4-40d9-b630-fcd545096f63 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:31.788352 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc168669-1b2e-40a7-9ec0-29dc31c71310 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:31.789653 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc168669-1b2e-40a7-9ec0-29dc31c71310 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:31.790105 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-496b2eb8-eff4-40d9-b630-fcd545096f63 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:31.790714 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-496b2eb8-eff4-40d9-b630-fcd545096f63 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:31.791528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-496b2eb8-eff4-40d9-b630-fcd545096f63 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:31.791844 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc168669-1b2e-40a7-9ec0-29dc31c71310 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:31.792117 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-496b2eb8-eff4-40d9-b630-fcd545096f63 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:31.792382 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc168669-1b2e-40a7-9ec0-29dc31c71310 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:32.016992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bc168669-1b2e-40a7-9ec0-29dc31c71310 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:32.019599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-496b2eb8-eff4-40d9-b630-fcd545096f63 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:32.028524 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-496b2eb8-eff4-40d9-b630-fcd545096f63 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1554 microversion: 2.1 time: 0.254520 May 19 13:55:32.032218 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bc168669-1b2e-40a7-9ec0-29dc31c71310 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.259592 May 19 13:55:32.032893 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 124/249] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:31 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:32.038385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 126/250] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:31 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1554 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:32.250077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-14c03bb2-787e-445c-a24d-53dbc5b13f55 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:32.250839 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-14c03bb2-787e-445c-a24d-53dbc5b13f55 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:32.258324 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-14c03bb2-787e-445c-a24d-53dbc5b13f55 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:32.258849 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-14c03bb2-787e-445c-a24d-53dbc5b13f55 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:32.259745 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-14c03bb2-787e-445c-a24d-53dbc5b13f55 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:32.260474 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-14c03bb2-787e-445c-a24d-53dbc5b13f55 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:32.303274 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-05f71a60-ac3a-4d6a-86eb-465fa8d83e66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:32.303979 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-05f71a60-ac3a-4d6a-86eb-465fa8d83e66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:32.310448 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-05f71a60-ac3a-4d6a-86eb-465fa8d83e66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:32.311203 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-05f71a60-ac3a-4d6a-86eb-465fa8d83e66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:32.311972 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-05f71a60-ac3a-4d6a-86eb-465fa8d83e66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:32.312400 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-05f71a60-ac3a-4d6a-86eb-465fa8d83e66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:32.561714 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-14c03bb2-787e-445c-a24d-53dbc5b13f55 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:32.573594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-14c03bb2-787e-445c-a24d-53dbc5b13f55 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.326854 May 19 13:55:32.574361 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 127/251] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:32 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:32.617612 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-05f71a60-ac3a-4d6a-86eb-465fa8d83e66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:32.626055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-05f71a60-ac3a-4d6a-86eb-465fa8d83e66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1366 microversion: 2.1 time: 0.326336 May 19 13:55:32.629820 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 125/252] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:32 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:33.046083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e9cefe16-407a-4bc9-bd56-4273ef5f85a7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:33.046738 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e9cefe16-407a-4bc9-bd56-4273ef5f85a7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:33.049506 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-acc1883c-9b2f-4050-a372-9280a61d9f10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:33.050149 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-acc1883c-9b2f-4050-a372-9280a61d9f10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:33.055843 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e9cefe16-407a-4bc9-bd56-4273ef5f85a7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.056289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e9cefe16-407a-4bc9-bd56-4273ef5f85a7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:33.059396 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-acc1883c-9b2f-4050-a372-9280a61d9f10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.059782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e9cefe16-407a-4bc9-bd56-4273ef5f85a7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.059913 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-acc1883c-9b2f-4050-a372-9280a61d9f10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:33.061989 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e9cefe16-407a-4bc9-bd56-4273ef5f85a7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:33.063815 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-acc1883c-9b2f-4050-a372-9280a61d9f10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.064195 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-acc1883c-9b2f-4050-a372-9280a61d9f10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:33.436541 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e9cefe16-407a-4bc9-bd56-4273ef5f85a7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:33.437168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-acc1883c-9b2f-4050-a372-9280a61d9f10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:33.445358 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-acc1883c-9b2f-4050-a372-9280a61d9f10 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.399770 May 19 13:55:33.450415 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e9cefe16-407a-4bc9-bd56-4273ef5f85a7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1554 microversion: 2.1 time: 0.409443 May 19 13:55:33.455920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 126/253] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:33 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:33.462591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 128/254] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:33 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1554 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:33.591164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5a847edc-65d5-42b3-8140-bdc3b5be18aa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:33.592584 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5a847edc-65d5-42b3-8140-bdc3b5be18aa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:33.599403 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a847edc-65d5-42b3-8140-bdc3b5be18aa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.600330 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a847edc-65d5-42b3-8140-bdc3b5be18aa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:33.601336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a847edc-65d5-42b3-8140-bdc3b5be18aa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.602057 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a847edc-65d5-42b3-8140-bdc3b5be18aa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:33.647162 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-442f40ed-5edf-487b-a115-2cf107c77544 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:33.647782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-442f40ed-5edf-487b-a115-2cf107c77544 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:33.655269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-442f40ed-5edf-487b-a115-2cf107c77544 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.656039 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-442f40ed-5edf-487b-a115-2cf107c77544 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:33.656945 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-442f40ed-5edf-487b-a115-2cf107c77544 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.657381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-442f40ed-5edf-487b-a115-2cf107c77544 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:33.878852 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5a847edc-65d5-42b3-8140-bdc3b5be18aa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:33.881900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-442f40ed-5edf-487b-a115-2cf107c77544 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:33.889900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-442f40ed-5edf-487b-a115-2cf107c77544 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1556 microversion: 2.1 time: 0.249121 May 19 13:55:33.890491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 129/255] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:33 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1556 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:33.893260 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5a847edc-65d5-42b3-8140-bdc3b5be18aa tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.306295 May 19 13:55:33.894338 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 127/256] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:33 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:33.909031 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4a8a36cf-0789-4cee-b01b-73da3fb54d9d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:33.910608 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4a8a36cf-0789-4cee-b01b-73da3fb54d9d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:33.923354 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a8a36cf-0789-4cee-b01b-73da3fb54d9d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.923805 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a8a36cf-0789-4cee-b01b-73da3fb54d9d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:33.924575 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a8a36cf-0789-4cee-b01b-73da3fb54d9d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:33.925842 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a8a36cf-0789-4cee-b01b-73da3fb54d9d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:34.027839 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4a8a36cf-0789-4cee-b01b-73da3fb54d9d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125019 May 19 13:55:34.028864 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 130/257] 10.222.0.52 () {58 vars in 1274 bytes} [Thu May 19 13:55:33 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:34.463938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5faddfb9-cd97-45ea-bdda-2cf832424574 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:34.470139 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1411507c-eab1-4749-b87d-e9f7047894f8 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:34.471091 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5faddfb9-cd97-45ea-bdda-2cf832424574 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:34.473375 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1411507c-eab1-4749-b87d-e9f7047894f8 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:34.486577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1411507c-eab1-4749-b87d-e9f7047894f8 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:34.487834 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1411507c-eab1-4749-b87d-e9f7047894f8 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:34.488071 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-cd97-45ea-bdda-2cf832424574 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:34.489015 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-cd97-45ea-bdda-2cf832424574 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:34.489744 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1411507c-eab1-4749-b87d-e9f7047894f8 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:34.490662 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-cd97-45ea-bdda-2cf832424574 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:34.491406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1411507c-eab1-4749-b87d-e9f7047894f8 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:34.493011 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5faddfb9-cd97-45ea-bdda-2cf832424574 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:34.870794 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1411507c-eab1-4749-b87d-e9f7047894f8 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:34.879999 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1411507c-eab1-4749-b87d-e9f7047894f8 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1554 microversion: 2.1 time: 0.414625 May 19 13:55:34.884806 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 131/258] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:34 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1554 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:34.911869 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c5b52e97-1333-4774-8584-9c7131c1c901 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:34.912676 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c5b52e97-1333-4774-8584-9c7131c1c901 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:34.926681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5b52e97-1333-4774-8584-9c7131c1c901 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:34.930417 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5b52e97-1333-4774-8584-9c7131c1c901 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:34.931457 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5b52e97-1333-4774-8584-9c7131c1c901 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:34.932581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5b52e97-1333-4774-8584-9c7131c1c901 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:34.992428 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5faddfb9-cd97-45ea-bdda-2cf832424574 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:35.008155 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5faddfb9-cd97-45ea-bdda-2cf832424574 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1314 microversion: 2.1 time: 0.548615 May 19 13:55:35.009068 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 128/259] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:34 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:35.545192 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c5b52e97-1333-4774-8584-9c7131c1c901 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:35.555083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c5b52e97-1333-4774-8584-9c7131c1c901 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.648203 May 19 13:55:35.566076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 132/260] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:34 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:35.900279 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-430338ad-b6f9-403d-bb38-92869b643e65 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:35.901469 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-430338ad-b6f9-403d-bb38-92869b643e65 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:35.915412 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-430338ad-b6f9-403d-bb38-92869b643e65 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:35.916065 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-430338ad-b6f9-403d-bb38-92869b643e65 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:35.917001 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-430338ad-b6f9-403d-bb38-92869b643e65 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:35.923534 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-430338ad-b6f9-403d-bb38-92869b643e65 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:36.025817 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-54365480-e129-4d5c-b914-c825bda905ad tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:36.026622 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-54365480-e129-4d5c-b914-c825bda905ad tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:36.036683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-54365480-e129-4d5c-b914-c825bda905ad tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:36.039021 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-54365480-e129-4d5c-b914-c825bda905ad tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:36.039817 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-54365480-e129-4d5c-b914-c825bda905ad tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:36.040236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-54365480-e129-4d5c-b914-c825bda905ad tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:36.388932 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-430338ad-b6f9-403d-bb38-92869b643e65 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:36.404090 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-430338ad-b6f9-403d-bb38-92869b643e65 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1554 microversion: 2.1 time: 0.507962 May 19 13:55:36.405406 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 129/261] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:35 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1554 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:36.414527 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-3f4a98eb-6b40-4f2b-8e97-74a2724f4ee6 req-a7772fdc-6499-4816-b2ad-cec7d161a8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d532aab-b9b2-43ad-8536-36ac47c34097", "name": "network-vif-unplugged", "status": "completed", "tag": "b7ff7282-c5a8-4eda-8af0-d48c8e33d4ad"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:36.424061 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-3f4a98eb-6b40-4f2b-8e97-74a2724f4ee6 req-a7772fdc-6499-4816-b2ad-cec7d161a8e1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:36.424498 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-3f4a98eb-6b40-4f2b-8e97-74a2724f4ee6 req-a7772fdc-6499-4816-b2ad-cec7d161a8e1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:36.438733 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-3f4a98eb-6b40-4f2b-8e97-74a2724f4ee6 req-a7772fdc-6499-4816-b2ad-cec7d161a8e1 service nova] Creating event network-vif-unplugged:b7ff7282-c5a8-4eda-8af0-d48c8e33d4ad for instance 2d532aab-b9b2-43ad-8536-36ac47c34097 on hv-cinder-78481 May 19 13:55:36.447699 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-3f4a98eb-6b40-4f2b-8e97-74a2724f4ee6 req-a7772fdc-6499-4816-b2ad-cec7d161a8e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040761 May 19 13:55:36.448852 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 130/262] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:36.491189 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-54365480-e129-4d5c-b914-c825bda905ad tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:36.501869 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-54365480-e129-4d5c-b914-c825bda905ad tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1499 microversion: 2.1 time: 0.480199 May 19 13:55:36.503272 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 133/263] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:36 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1499 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:36.575578 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5ae4ce35-c9c1-43c7-9223-837c12330ece tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:36.577296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5ae4ce35-c9c1-43c7-9223-837c12330ece tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:36.592667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5ae4ce35-c9c1-43c7-9223-837c12330ece tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:36.594578 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5ae4ce35-c9c1-43c7-9223-837c12330ece tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:36.596181 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5ae4ce35-c9c1-43c7-9223-837c12330ece tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:36.614092 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5ae4ce35-c9c1-43c7-9223-837c12330ece tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:36.699402 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-ec812609-fd19-4fcc-bfd9-a6ecf024dfe6 req-c06f12bb-e43a-41d9-bbd5-9d3851e76029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e425ccc-4508-4267-bc69-5590c1f503ec", "tag": "a4da582a-6527-48e4-b52c-7d888d7e053a"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:36.715155 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-ec812609-fd19-4fcc-bfd9-a6ecf024dfe6 req-c06f12bb-e43a-41d9-bbd5-9d3851e76029 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:36.718659 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-ec812609-fd19-4fcc-bfd9-a6ecf024dfe6 req-c06f12bb-e43a-41d9-bbd5-9d3851e76029 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:36.737692 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-ec812609-fd19-4fcc-bfd9-a6ecf024dfe6 req-c06f12bb-e43a-41d9-bbd5-9d3851e76029 service nova] Creating event network-changed:a4da582a-6527-48e4-b52c-7d888d7e053a for instance 2e425ccc-4508-4267-bc69-5590c1f503ec on hv-cinder-78481 May 19 13:55:36.743529 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-ec812609-fd19-4fcc-bfd9-a6ecf024dfe6 req-c06f12bb-e43a-41d9-bbd5-9d3851e76029 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048301 May 19 13:55:36.744980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 134/264] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:55:37.030743 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5ae4ce35-c9c1-43c7-9223-837c12330ece tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:37.041238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5ae4ce35-c9c1-43c7-9223-837c12330ece tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.472677 May 19 13:55:37.055023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 131/265] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:36 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:37.424134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-394a5ac3-aff3-4ca5-bb16-17cc18cfb5e7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:37.424739 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-394a5ac3-aff3-4ca5-bb16-17cc18cfb5e7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:37.436559 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-394a5ac3-aff3-4ca5-bb16-17cc18cfb5e7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:37.439056 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-394a5ac3-aff3-4ca5-bb16-17cc18cfb5e7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:37.442607 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-394a5ac3-aff3-4ca5-bb16-17cc18cfb5e7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:37.443491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-394a5ac3-aff3-4ca5-bb16-17cc18cfb5e7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:37.540251 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0b445f44-d169-4294-9867-6079e8039cc5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:37.541077 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0b445f44-d169-4294-9867-6079e8039cc5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:37.548044 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b445f44-d169-4294-9867-6079e8039cc5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:37.548827 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b445f44-d169-4294-9867-6079e8039cc5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:37.549840 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b445f44-d169-4294-9867-6079e8039cc5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:37.550510 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b445f44-d169-4294-9867-6079e8039cc5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:37.598923 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0b445f44-d169-4294-9867-6079e8039cc5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:55:37.652147 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:37.787493 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-394a5ac3-aff3-4ca5-bb16-17cc18cfb5e7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:37.806091 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-394a5ac3-aff3-4ca5-bb16-17cc18cfb5e7 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1346 microversion: 2.1 time: 0.379374 May 19 13:55:37.807112 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 135/266] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:37 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1346 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:37.826771 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0b445f44-d169-4294-9867-6079e8039cc5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 204 len: 0 microversion: 2.1 time: 0.289718 May 19 13:55:37.836216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 132/267] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:55:37 2022] DELETE /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:55:37.836965 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-03af4045-3b1d-4632-8c6f-4b1280bf851a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:37.838419 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-03af4045-3b1d-4632-8c6f-4b1280bf851a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:37.847846 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-03af4045-3b1d-4632-8c6f-4b1280bf851a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:37.850005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-03af4045-3b1d-4632-8c6f-4b1280bf851a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:37.852895 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-03af4045-3b1d-4632-8c6f-4b1280bf851a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:37.853538 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-03af4045-3b1d-4632-8c6f-4b1280bf851a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:37.908557 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:38.066247 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bd00ec7c-c228-4726-aac4-8e79aa1eaecc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:38.067624 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bd00ec7c-c228-4726-aac4-8e79aa1eaecc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:38.082324 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bd00ec7c-c228-4726-aac4-8e79aa1eaecc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:38.083073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bd00ec7c-c228-4726-aac4-8e79aa1eaecc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:38.084080 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bd00ec7c-c228-4726-aac4-8e79aa1eaecc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:38.084716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bd00ec7c-c228-4726-aac4-8e79aa1eaecc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:38.109761 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-03af4045-3b1d-4632-8c6f-4b1280bf851a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:38.123335 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-03af4045-3b1d-4632-8c6f-4b1280bf851a tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1505 microversion: 2.1 time: 0.290522 May 19 13:55:38.123937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 136/268] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:37 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:38.337513 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bd00ec7c-c228-4726-aac4-8e79aa1eaecc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:38.349610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bd00ec7c-c228-4726-aac4-8e79aa1eaecc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.288929 May 19 13:55:38.350811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 133/269] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:38 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:38.763285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-c49f6824-cbae-4a47-b6d9-e312afb7fb79 req-73add0a2-8cd7-45d0-bac8-0ccf3d73c5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d532aab-b9b2-43ad-8536-36ac47c34097", "name": "network-vif-deleted", "tag": "b7ff7282-c5a8-4eda-8af0-d48c8e33d4ad"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:38.771809 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-c49f6824-cbae-4a47-b6d9-e312afb7fb79 req-73add0a2-8cd7-45d0-bac8-0ccf3d73c5d5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:38.772250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-c49f6824-cbae-4a47-b6d9-e312afb7fb79 req-73add0a2-8cd7-45d0-bac8-0ccf3d73c5d5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:38.783979 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-c49f6824-cbae-4a47-b6d9-e312afb7fb79 req-73add0a2-8cd7-45d0-bac8-0ccf3d73c5d5 service nova] Creating event network-vif-deleted:b7ff7282-c5a8-4eda-8af0-d48c8e33d4ad for instance 2d532aab-b9b2-43ad-8536-36ac47c34097 on hv-cinder-78481 May 19 13:55:38.789766 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-c49f6824-cbae-4a47-b6d9-e312afb7fb79 req-73add0a2-8cd7-45d0-bac8-0ccf3d73c5d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030244 May 19 13:55:38.790543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 137/270] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:38.825418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:38.827168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:38.835654 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:38.836116 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:38.836866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:38.837496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:38.874566 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:38.875050 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:38.875524 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lazy-loading 'fault' on Instance uuid 2d532aab-b9b2-43ad-8536-36ac47c34097 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:55:38.921639 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd88c8e9166940d8a09657997e6214d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89676dbc35634ec7994040c93f693f7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:38.932962 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-11465c77-6cf3-4bd6-87ff-f6d18b6e82e0 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 200 len: 1351 microversion: 2.1 time: 0.112690 May 19 13:55:38.933617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 134/271] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:38 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 1351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:39.142968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b2c830f3-7d56-4cef-a753-9cfb8815a3bf tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:39.143671 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b2c830f3-7d56-4cef-a753-9cfb8815a3bf tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:39.149893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b2c830f3-7d56-4cef-a753-9cfb8815a3bf tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:39.150341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b2c830f3-7d56-4cef-a753-9cfb8815a3bf tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:39.151143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b2c830f3-7d56-4cef-a753-9cfb8815a3bf tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:39.151581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b2c830f3-7d56-4cef-a753-9cfb8815a3bf tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:39.327550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b2c830f3-7d56-4cef-a753-9cfb8815a3bf tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:39.335032 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b2c830f3-7d56-4cef-a753-9cfb8815a3bf tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1505 microversion: 2.1 time: 0.197459 May 19 13:55:39.335884 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 138/272] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:39 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:39.367730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a5b35745-909a-4a2a-b9b0-9da358ed8be0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:39.368337 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a5b35745-909a-4a2a-b9b0-9da358ed8be0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:39.375599 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5b35745-909a-4a2a-b9b0-9da358ed8be0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:39.376055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5b35745-909a-4a2a-b9b0-9da358ed8be0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:39.376827 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5b35745-909a-4a2a-b9b0-9da358ed8be0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:39.377268 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5b35745-909a-4a2a-b9b0-9da358ed8be0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:39.542656 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a5b35745-909a-4a2a-b9b0-9da358ed8be0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:39.552617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a5b35745-909a-4a2a-b9b0-9da358ed8be0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.188386 May 19 13:55:39.553198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 135/273] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:39 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:39.951683 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:39.952611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:39.964993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:39.965930 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:39.972239 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:39.972702 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:40.006225 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] HTTP exception thrown: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Request method failure captured: May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 HTTP/1.1 May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwItLC2oxsrL-lYhkhNjFBheNlf1nzkJIR_CLNYbEjHd19ZAJHGe3imW3S9OZkfn0eh127H_ItK0ZuInSsuiU2eeqSrO_t5srShD4RGoMFWEMsFbodZqme_zBw8IGbGOC_mdJn0BR4WeeXXEn4809KzZshbkC8RmzPZXkevRfD_luw May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89676dbc35634ec7994040c93f693f7c May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:55:40.025893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89676dbc35634ec7994040c93f693f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89676dbc35634ec7994040c93f693f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89676dbc35634ec7994040c93f693f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89676dbc35634ec7994040c93f693f7c"}]}] May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89676dbc35634ec7994040c93f693f7c May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-DeleteServersTestJSON-1927217060-project May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: fd88c8e9166940d8a09657997e6214d6 May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-DeleteServersTestJSON-1927217060-project May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.027578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '2d532aab-b9b2-43ad-8536-36ac47c34097'} May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:55:40.028539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.030337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:40.033674 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Returning 404 to user: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:55:40.035053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-49db6086-98d3-4239-b995-17cc0716a553 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 404 len: 111 microversion: 2.1 time: 0.088272 May 19 13:55:40.036193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 139/274] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:39 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:55:40.245402 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:40.246728 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:40.254627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:40.255675 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:40.256656 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:40.257276 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:40.272684 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] HTTP exception thrown: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Request method failure captured: May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097/os-volume_attachments HTTP/1.1 May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwItLC2oxsrL-lYhkhNjFBheNlf1nzkJIR_CLNYbEjHd19ZAJHGe3imW3S9OZkfn0eh127H_ItK0ZuInSsuiU2eeqSrO_t5srShD4RGoMFWEMsFbodZqme_zBw8IGbGOC_mdJn0BR4WeeXXEn4809KzZshbkC8RmzPZXkevRfD_luw May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 89676dbc35634ec7994040c93f693f7c May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:55:40.278579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89676dbc35634ec7994040c93f693f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89676dbc35634ec7994040c93f693f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89676dbc35634ec7994040c93f693f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89676dbc35634ec7994040c93f693f7c"}]}] May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 89676dbc35634ec7994040c93f693f7c May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-DeleteServersTestJSON-1927217060-project May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: fd88c8e9166940d8a09657997e6214d6 May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-DeleteServersTestJSON-1927217060-project May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.280334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'server_id': '2d532aab-b9b2-43ad-8536-36ac47c34097'} May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:55:40.281261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:40.283095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:55:40.284382 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Returning 404 to user: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:55:40.284382 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d3c830d4-5528-47d4-a1a8-9c64399fe71f tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040580 May 19 13:55:40.284707 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 136/275] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:55:40 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:55:40.354414 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-921d511e-e3a9-45f7-b8dd-94f93f0384f2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:40.366310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-921d511e-e3a9-45f7-b8dd-94f93f0384f2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:40.374623 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-921d511e-e3a9-45f7-b8dd-94f93f0384f2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:40.376094 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-921d511e-e3a9-45f7-b8dd-94f93f0384f2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:40.377545 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-921d511e-e3a9-45f7-b8dd-94f93f0384f2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:40.378161 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-921d511e-e3a9-45f7-b8dd-94f93f0384f2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:40.569685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f10c315d-5998-4792-971d-d22b9782c9af tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:40.570368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f10c315d-5998-4792-971d-d22b9782c9af tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:40.579084 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f10c315d-5998-4792-971d-d22b9782c9af tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:40.579531 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f10c315d-5998-4792-971d-d22b9782c9af tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:40.580308 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f10c315d-5998-4792-971d-d22b9782c9af tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:40.580744 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f10c315d-5998-4792-971d-d22b9782c9af tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:40.857919 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-921d511e-e3a9-45f7-b8dd-94f93f0384f2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:40.865927 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-921d511e-e3a9-45f7-b8dd-94f93f0384f2 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1505 microversion: 2.1 time: 0.516810 May 19 13:55:40.871232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 140/276] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:40 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1505 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:40.910753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-b6960b9c-0820-4005-a7c0-0f9ac782ddd9 req-9c01f399-5494-45f2-bfc7-e27cd6f763cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72fbcca9-a311-4ec9-b2b6-569b9a96e460", "name": "network-vif-deleted", "tag": "12af5875-0105-4c5e-ab8b-4f48b11e4870"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:40.919141 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-b6960b9c-0820-4005-a7c0-0f9ac782ddd9 req-9c01f399-5494-45f2-bfc7-e27cd6f763cf service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:40.920170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-b6960b9c-0820-4005-a7c0-0f9ac782ddd9 req-9c01f399-5494-45f2-bfc7-e27cd6f763cf service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:40.933687 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f10c315d-5998-4792-971d-d22b9782c9af tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:40.937075 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-b6960b9c-0820-4005-a7c0-0f9ac782ddd9 req-9c01f399-5494-45f2-bfc7-e27cd6f763cf service nova] Creating event network-vif-deleted:12af5875-0105-4c5e-ab8b-4f48b11e4870 for instance 72fbcca9-a311-4ec9-b2b6-569b9a96e460 on hv-cinder-78481 May 19 13:55:40.942171 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-b6960b9c-0820-4005-a7c0-0f9ac782ddd9 req-9c01f399-5494-45f2-bfc7-e27cd6f763cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035031 May 19 13:55:40.942889 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 141/277] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:40.943605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f10c315d-5998-4792-971d-d22b9782c9af tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.377937 May 19 13:55:40.951954 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 137/278] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:40 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:41.883570 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-10d80e5c-2a63-49ea-98d6-ce2d127464e6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:41.884258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-10d80e5c-2a63-49ea-98d6-ce2d127464e6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:41.890480 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10d80e5c-2a63-49ea-98d6-ce2d127464e6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:41.890959 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10d80e5c-2a63-49ea-98d6-ce2d127464e6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:41.891721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10d80e5c-2a63-49ea-98d6-ce2d127464e6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:41.892155 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10d80e5c-2a63-49ea-98d6-ce2d127464e6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:41.961268 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-10d80e5c-2a63-49ea-98d6-ce2d127464e6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:41.961565 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e58af063-d4f8-4bce-bf86-24374cdd9e58 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:41.962269 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e58af063-d4f8-4bce-bf86-24374cdd9e58 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:41.969900 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e58af063-d4f8-4bce-bf86-24374cdd9e58 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:41.970497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e58af063-d4f8-4bce-bf86-24374cdd9e58 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:41.971155 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-10d80e5c-2a63-49ea-98d6-ce2d127464e6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1463 microversion: 2.1 time: 0.091770 May 19 13:55:41.971312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e58af063-d4f8-4bce-bf86-24374cdd9e58 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:41.971746 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 142/279] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:41 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1463 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:41.972159 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e58af063-d4f8-4bce-bf86-24374cdd9e58 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:42.102372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e58af063-d4f8-4bce-bf86-24374cdd9e58 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:42.110605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e58af063-d4f8-4bce-bf86-24374cdd9e58 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.153907 May 19 13:55:42.111214 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 138/280] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:41 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:42.987891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:42.988536 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:42.994560 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:42.995047 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:42.995808 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:42.996243 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:43.029718 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:43.030159 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:43.030595 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lazy-loading 'fault' on Instance uuid 72fbcca9-a311-4ec9-b2b6-569b9a96e460 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:55:43.077816 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:43.085432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2a83ec3f-5046-4960-bfd6-8c7e98cef47b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 200 len: 1304 microversion: 2.1 time: 0.101379 May 19 13:55:43.085982 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 143/281] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:42 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:43.128252 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d3190a5f-62c6-46cb-adc9-923ded4b6578 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:43.129142 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d3190a5f-62c6-46cb-adc9-923ded4b6578 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:43.135700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d3190a5f-62c6-46cb-adc9-923ded4b6578 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:43.136330 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d3190a5f-62c6-46cb-adc9-923ded4b6578 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:43.137086 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d3190a5f-62c6-46cb-adc9-923ded4b6578 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:43.137516 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d3190a5f-62c6-46cb-adc9-923ded4b6578 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:43.276250 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d3190a5f-62c6-46cb-adc9-923ded4b6578 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:43.284591 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d3190a5f-62c6-46cb-adc9-923ded4b6578 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.160173 May 19 13:55:43.285163 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 139/282] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:43 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:44.102753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:44.103396 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: 72fbcca9-a311-4ec9-b2b6-569b9a96e460] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:44.109442 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.109879 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.110622 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.111074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.124173 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] HTTP exception thrown: Instance 72fbcca9-a311-4ec9-b2b6-569b9a96e460 could not be found. May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Request method failure captured: May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 HTTP/1.1 May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwl8I61l79dO2bRyl6NxXstAAe1Sx_YIIq8gu9dF3dwENSL_A-PHTYsttCnrNQsvajRGaYsEhuuQ-WbMK3v_-AtJNmv1t-7TPz_vkZudgQAe0B8aKINswHMU0_3-2v8--nUX31KSSiknEao-3gE2twkuRA_SbE9VOz0D3Zk0ARq8KQ May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 4fe46ffac52d412daf3663e2ab1273de May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesActionsTest-47775183 May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:55:44.125792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4fe46ffac52d412daf3663e2ab1273de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fe46ffac52d412daf3663e2ab1273de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4fe46ffac52d412daf3663e2ab1273de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fe46ffac52d412daf3663e2ab1273de"}]}] May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesActionsTest-47775183 May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 4fe46ffac52d412daf3663e2ab1273de May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesActionsTest-47775183 May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesActionsTest-47775183-project May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: a9a3080f9aef4323952eed19ef9bb074 May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesActionsTest-47775183-project May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 72fbcca9-a311-4ec9-b2b6-569b9a96e460 could not be found. May 19 13:55:44.127203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '72fbcca9-a311-4ec9-b2b6-569b9a96e460'} May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72fbcca9-a311-4ec9-b2b6-569b9a96e460 could not be found. May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:55:44.128066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72fbcca9-a311-4ec9-b2b6-569b9a96e460 could not be found. May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72fbcca9-a311-4ec9-b2b6-569b9a96e460 could not be found. May 19 13:55:44.129615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.130757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Returning 404 to user: Instance 72fbcca9-a311-4ec9-b2b6-569b9a96e460 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:55:44.130757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ad06fbb5-28d9-411d-90c0-58d2c11de533 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460" status: 404 len: 111 microversion: 2.1 time: 0.028552 May 19 13:55:44.130757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 144/283] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:44 2022] GET /compute/v2.1/servers/72fbcca9-a311-4ec9-b2b6-569b9a96e460 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:55:44.234208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1764145590", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "networks": [{"uuid": "8ff3cec5-cb61-42f1-9f06-2f870efcc775"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:44.287224 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] validate_networks() for [('8ff3cec5-cb61-42f1-9f06-2f870efcc775', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:55:44.301316 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-baf9eb30-a15a-4f67-babb-073f91e234db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:44.301836 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-baf9eb30-a15a-4f67-babb-073f91e234db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:44.307757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-baf9eb30-a15a-4f67-babb-073f91e234db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.308198 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-baf9eb30-a15a-4f67-babb-073f91e234db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.308941 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-baf9eb30-a15a-4f67-babb-073f91e234db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.309366 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-baf9eb30-a15a-4f67-babb-073f91e234db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.501921 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-baf9eb30-a15a-4f67-babb-073f91e234db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:44.520667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-baf9eb30-a15a-4f67-babb-073f91e234db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.223146 May 19 13:55:44.521844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 145/284] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:44 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:55:44.757986 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:55:44.758840 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:55:44.759603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:55:44.760295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:55:44.761283 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:55:44.765605 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:44.766488 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:44.773737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.774541 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.775713 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.776374 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.776584 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.777063 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.778400 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.780210 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.794091 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] HTTP exception thrown: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Request method failure captured: May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 HTTP/1.1 May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwItLC2oxsrL-lYhkhNjFBheNlf1nzkJIR_CLNYbEjHd19ZAJHGe3imW3S9OZkfn0eh127H_ItK0ZuInSsuiU2eeqSrO_t5srShD4RGoMFWEMsFbodZqme_zBw8IGbGOC_mdJn0BR4WeeXXEn4809KzZshbkC8RmzPZXkevRfD_luw May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89676dbc35634ec7994040c93f693f7c May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:55:44.796572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89676dbc35634ec7994040c93f693f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89676dbc35634ec7994040c93f693f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89676dbc35634ec7994040c93f693f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89676dbc35634ec7994040c93f693f7c"}]}] May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89676dbc35634ec7994040c93f693f7c May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-DeleteServersTestJSON-1927217060-project May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: fd88c8e9166940d8a09657997e6214d6 May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-DeleteServersTestJSON-1927217060-project May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.797753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '2d532aab-b9b2-43ad-8536-36ac47c34097'} May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:55:44.798403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.799508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.802589 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Returning 404 to user: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:55:44.802589 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0f049c4f-e3d4-4eab-a447-a8468205ddd1 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 404 len: 111 microversion: 2.1 time: 0.037463 May 19 13:55:44.802894 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Getting quotas for project 4fe46ffac52d412daf3663e2ab1273de. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:55:44.803059 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 146/285] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:55:44 2022] DELETE /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:55:44.804970 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Getting quotas for user a9a3080f9aef4323952eed19ef9bb074 and project 4fe46ffac52d412daf3663e2ab1273de. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:55:44.807435 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:44.808052 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] [instance: 2d532aab-b9b2-43ad-8536-36ac47c34097] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:44.818414 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.818781 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.819418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:55:44.820055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:44.820836 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:44.821924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:55:44.837485 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] HTTP exception thrown: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Request method failure captured: May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 HTTP/1.1 May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwItLC2oxsrL-lYhkhNjFBheNlf1nzkJIR_CLNYbEjHd19ZAJHGe3imW3S9OZkfn0eh127H_ItK0ZuInSsuiU2eeqSrO_t5srShD4RGoMFWEMsFbodZqme_zBw8IGbGOC_mdJn0BR4WeeXXEn4809KzZshbkC8RmzPZXkevRfD_luw May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89676dbc35634ec7994040c93f693f7c May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:55:44.839044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89676dbc35634ec7994040c93f693f7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89676dbc35634ec7994040c93f693f7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89676dbc35634ec7994040c93f693f7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89676dbc35634ec7994040c93f693f7c"}]}] May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89676dbc35634ec7994040c93f693f7c May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-DeleteServersTestJSON-1927217060 May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-DeleteServersTestJSON-1927217060-project May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: fd88c8e9166940d8a09657997e6214d6 May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-DeleteServersTestJSON-1927217060-project May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.840204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '2d532aab-b9b2-43ad-8536-36ac47c34097'} May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:55:44.840856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. May 19 13:55:44.841920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:55:44.844357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] Returning 404 to user: Instance 2d532aab-b9b2-43ad-8536-36ac47c34097 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:55:44.844357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4b5733a7-e9e2-4f03-a204-5fe5b14d9833 tempest-DeleteServersTestJSON-1927217060 tempest-DeleteServersTestJSON-1927217060-project] 10.222.0.52 "GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097" status: 404 len: 111 microversion: 2.1 time: 0.037460 May 19 13:55:44.844357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 147/286] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:44 2022] GET /compute/v2.1/servers/2d532aab-b9b2-43ad-8536-36ac47c34097 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:55:44.884372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-07f17b49-ba92-4a4f-90fc-bbea187fc337 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654132 May 19 13:55:44.885667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 140/287] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:55:44.897779 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1b918804-2dab-4ba7-befa-ff170c0335e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:44.898886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1b918804-2dab-4ba7-befa-ff170c0335e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:44.984570 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1b918804-2dab-4ba7-befa-ff170c0335e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:44.993449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1b918804-2dab-4ba7-befa-ff170c0335e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1214 microversion: 2.1 time: 0.101070 May 19 13:55:44.995526 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 148/288] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:44 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:45.538929 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2e794574-84e2-46ff-b984-98de80976162 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:45.539546 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2e794574-84e2-46ff-b984-98de80976162 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:45.546429 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e794574-84e2-46ff-b984-98de80976162 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:45.546899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e794574-84e2-46ff-b984-98de80976162 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:45.547672 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e794574-84e2-46ff-b984-98de80976162 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:45.548108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e794574-84e2-46ff-b984-98de80976162 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:45.708905 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e794574-84e2-46ff-b984-98de80976162 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:45.717602 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2e794574-84e2-46ff-b984-98de80976162 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.182791 May 19 13:55:45.726727 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 141/289] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:45 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:46.014966 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2fa12aa8-3b0b-48c2-909d-93e8769fe131 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:46.015828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2fa12aa8-3b0b-48c2-909d-93e8769fe131 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:46.027813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2fa12aa8-3b0b-48c2-909d-93e8769fe131 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:46.028553 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2fa12aa8-3b0b-48c2-909d-93e8769fe131 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:46.030583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2fa12aa8-3b0b-48c2-909d-93e8769fe131 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:46.031267 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2fa12aa8-3b0b-48c2-909d-93e8769fe131 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:46.115221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2fa12aa8-3b0b-48c2-909d-93e8769fe131 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:46.123296 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2fa12aa8-3b0b-48c2-909d-93e8769fe131 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1218 microversion: 2.1 time: 0.113173 May 19 13:55:46.123851 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 149/290] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:46 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:46.733535 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d2803765-c589-4344-9958-690ae528edca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:46.734211 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d2803765-c589-4344-9958-690ae528edca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:46.740612 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d2803765-c589-4344-9958-690ae528edca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:46.741068 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d2803765-c589-4344-9958-690ae528edca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:46.741845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d2803765-c589-4344-9958-690ae528edca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:46.742339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d2803765-c589-4344-9958-690ae528edca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:46.876797 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d2803765-c589-4344-9958-690ae528edca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:46.885758 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d2803765-c589-4344-9958-690ae528edca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.156175 May 19 13:55:46.886337 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 142/291] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:46 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:47.142555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-04d0d720-dc4c-4f58-84a9-c32adcccb628 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:47.143243 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-04d0d720-dc4c-4f58-84a9-c32adcccb628 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:47.150062 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-04d0d720-dc4c-4f58-84a9-c32adcccb628 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:47.150513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-04d0d720-dc4c-4f58-84a9-c32adcccb628 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:47.151425 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-04d0d720-dc4c-4f58-84a9-c32adcccb628 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:47.151938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-04d0d720-dc4c-4f58-84a9-c32adcccb628 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:47.216546 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-04d0d720-dc4c-4f58-84a9-c32adcccb628 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:47.224158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-04d0d720-dc4c-4f58-84a9-c32adcccb628 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1218 microversion: 2.1 time: 0.087530 May 19 13:55:47.224737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 150/292] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:47 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:47.903600 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a85444ff-78bd-44a0-9b90-620131189223 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:47.904238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a85444ff-78bd-44a0-9b90-620131189223 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:47.912581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a85444ff-78bd-44a0-9b90-620131189223 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:47.913031 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a85444ff-78bd-44a0-9b90-620131189223 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:47.913901 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a85444ff-78bd-44a0-9b90-620131189223 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:47.914335 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a85444ff-78bd-44a0-9b90-620131189223 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:48.055325 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a85444ff-78bd-44a0-9b90-620131189223 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:48.062890 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a85444ff-78bd-44a0-9b90-620131189223 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.163404 May 19 13:55:48.063464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 143/293] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:47 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:48.245611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5ccdac51-d9fd-45aa-9108-569d742475ec tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:48.245611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5ccdac51-d9fd-45aa-9108-569d742475ec tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:48.249074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5ccdac51-d9fd-45aa-9108-569d742475ec tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:48.249622 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5ccdac51-d9fd-45aa-9108-569d742475ec tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:48.250458 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5ccdac51-d9fd-45aa-9108-569d742475ec tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:48.251077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5ccdac51-d9fd-45aa-9108-569d742475ec tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:48.330986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5ccdac51-d9fd-45aa-9108-569d742475ec tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:48.339072 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5ccdac51-d9fd-45aa-9108-569d742475ec tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1218 microversion: 2.1 time: 0.101217 May 19 13:55:48.348849 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 151/294] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:48 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:49.080049 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fc0b5dae-6885-4e97-8687-6e8634821f1a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:49.080845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fc0b5dae-6885-4e97-8687-6e8634821f1a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:49.087487 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fc0b5dae-6885-4e97-8687-6e8634821f1a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:49.088004 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fc0b5dae-6885-4e97-8687-6e8634821f1a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:49.088908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fc0b5dae-6885-4e97-8687-6e8634821f1a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:49.089409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fc0b5dae-6885-4e97-8687-6e8634821f1a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:49.230132 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fc0b5dae-6885-4e97-8687-6e8634821f1a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:49.238799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fc0b5dae-6885-4e97-8687-6e8634821f1a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1521 microversion: 2.1 time: 0.163635 May 19 13:55:49.239487 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 144/295] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:49 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:49.356040 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-98198c51-6075-4a9e-b493-07b24351091f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:49.356656 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-98198c51-6075-4a9e-b493-07b24351091f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:49.363763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98198c51-6075-4a9e-b493-07b24351091f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:49.364185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98198c51-6075-4a9e-b493-07b24351091f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:49.364990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98198c51-6075-4a9e-b493-07b24351091f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:49.365428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98198c51-6075-4a9e-b493-07b24351091f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:49.433054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-98198c51-6075-4a9e-b493-07b24351091f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:49.441221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-98198c51-6075-4a9e-b493-07b24351091f tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1266 microversion: 2.1 time: 0.089091 May 19 13:55:49.441823 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 152/296] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:49 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:50.258888 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-44b8e7d9-e31b-4bb6-92d4-9ae93a7d5d23 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:50.259722 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-44b8e7d9-e31b-4bb6-92d4-9ae93a7d5d23 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:50.266663 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44b8e7d9-e31b-4bb6-92d4-9ae93a7d5d23 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:50.267138 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44b8e7d9-e31b-4bb6-92d4-9ae93a7d5d23 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:50.267914 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44b8e7d9-e31b-4bb6-92d4-9ae93a7d5d23 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:50.268352 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44b8e7d9-e31b-4bb6-92d4-9ae93a7d5d23 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:50.425159 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-44b8e7d9-e31b-4bb6-92d4-9ae93a7d5d23 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:50.433116 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-44b8e7d9-e31b-4bb6-92d4-9ae93a7d5d23 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1501 microversion: 2.1 time: 0.179408 May 19 13:55:50.433682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 145/297] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:50 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1501 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:50.449409 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5927a06d-7ad8-41b1-8df1-042a3c482800 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:50.450028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5927a06d-7ad8-41b1-8df1-042a3c482800 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:50.456868 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5927a06d-7ad8-41b1-8df1-042a3c482800 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:50.457314 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5927a06d-7ad8-41b1-8df1-042a3c482800 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:50.458071 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5927a06d-7ad8-41b1-8df1-042a3c482800 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:50.458503 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5927a06d-7ad8-41b1-8df1-042a3c482800 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:50.467295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3d016e3a-f172-45ea-9196-e14b3d36bcf6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:50.467938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3d016e3a-f172-45ea-9196-e14b3d36bcf6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:50.473862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3d016e3a-f172-45ea-9196-e14b3d36bcf6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:50.474509 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3d016e3a-f172-45ea-9196-e14b3d36bcf6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:50.475480 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3d016e3a-f172-45ea-9196-e14b3d36bcf6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:50.476155 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3d016e3a-f172-45ea-9196-e14b3d36bcf6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:50.619444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3d016e3a-f172-45ea-9196-e14b3d36bcf6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:50.631190 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3d016e3a-f172-45ea-9196-e14b3d36bcf6 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1272 microversion: 2.1 time: 0.167774 May 19 13:55:50.632262 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 146/298] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:50 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1272 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:50.710696 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5927a06d-7ad8-41b1-8df1-042a3c482800 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:50.718823 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5927a06d-7ad8-41b1-8df1-042a3c482800 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1513 microversion: 2.1 time: 0.273160 May 19 13:55:50.730663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 153/299] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:50 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:51.651530 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-887e00c9-2cce-4215-a701-d7905ac2ed3d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:51.653386 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-887e00c9-2cce-4215-a701-d7905ac2ed3d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:51.665617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-887e00c9-2cce-4215-a701-d7905ac2ed3d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:51.666513 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-887e00c9-2cce-4215-a701-d7905ac2ed3d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:51.667816 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-887e00c9-2cce-4215-a701-d7905ac2ed3d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:51.669087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-887e00c9-2cce-4215-a701-d7905ac2ed3d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:51.991891 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-887e00c9-2cce-4215-a701-d7905ac2ed3d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:52.001215 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-887e00c9-2cce-4215-a701-d7905ac2ed3d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1314 microversion: 2.1 time: 0.355240 May 19 13:55:52.001910 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 147/300] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:51 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:52.379817 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-33ed5005-fa88-4a80-86f7-2cbb3d1fa3ec tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:52.381524 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-33ed5005-fa88-4a80-86f7-2cbb3d1fa3ec tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:52.397996 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33ed5005-fa88-4a80-86f7-2cbb3d1fa3ec tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:52.398577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33ed5005-fa88-4a80-86f7-2cbb3d1fa3ec tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:52.400133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33ed5005-fa88-4a80-86f7-2cbb3d1fa3ec tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:52.406435 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33ed5005-fa88-4a80-86f7-2cbb3d1fa3ec tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:52.465599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-33ed5005-fa88-4a80-86f7-2cbb3d1fa3ec tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lazy-loading 'flavor' on Instance uuid 2b0a5331-be2a-4c5b-80ac-6be7220f2516 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:55:52.630299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-33ed5005-fa88-4a80-86f7-2cbb3d1fa3ec tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516/action" status: 200 len: 32 microversion: 2.1 time: 0.256322 May 19 13:55:52.650236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 154/301] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 13:55:52 2022] POST /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:55:52.657449 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-a82e85fc-2142-48f9-8f63-887dbfd99685 req-e1686879-6af7-40d3-b010-39da4bb5e5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7e32c58-34e9-4c74-9370-09aea3a3a06f", "tag": "8ac901fd-8be2-4f40-b91e-de640ebcef79"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:52.673575 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-a82e85fc-2142-48f9-8f63-887dbfd99685 req-e1686879-6af7-40d3-b010-39da4bb5e5d5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:52.674207 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-a82e85fc-2142-48f9-8f63-887dbfd99685 req-e1686879-6af7-40d3-b010-39da4bb5e5d5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:52.682780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d19cb5e9-a9cb-4da0-b587-c0e5124f524d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:52.685201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d19cb5e9-a9cb-4da0-b587-c0e5124f524d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:52.694238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-a82e85fc-2142-48f9-8f63-887dbfd99685 req-e1686879-6af7-40d3-b010-39da4bb5e5d5 service nova] Creating event network-changed:8ac901fd-8be2-4f40-b91e-de640ebcef79 for instance a7e32c58-34e9-4c74-9370-09aea3a3a06f on hv-cinder-78481 May 19 13:55:52.699608 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-a82e85fc-2142-48f9-8f63-887dbfd99685 req-e1686879-6af7-40d3-b010-39da4bb5e5d5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052302 May 19 13:55:52.700267 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 148/302] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:55:52.712601 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d19cb5e9-a9cb-4da0-b587-c0e5124f524d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:52.713055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d19cb5e9-a9cb-4da0-b587-c0e5124f524d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:52.713828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d19cb5e9-a9cb-4da0-b587-c0e5124f524d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:52.714281 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d19cb5e9-a9cb-4da0-b587-c0e5124f524d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:52.755700 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:53.018928 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-10336e4e-e3a8-435a-a82c-4b79a9c00e01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:53.019806 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-10336e4e-e3a8-435a-a82c-4b79a9c00e01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:53.035958 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10336e4e-e3a8-435a-a82c-4b79a9c00e01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:53.036410 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10336e4e-e3a8-435a-a82c-4b79a9c00e01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:53.037192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10336e4e-e3a8-435a-a82c-4b79a9c00e01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:53.037629 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10336e4e-e3a8-435a-a82c-4b79a9c00e01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:53.229919 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d19cb5e9-a9cb-4da0-b587-c0e5124f524d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:53.241063 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d19cb5e9-a9cb-4da0-b587-c0e5124f524d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.584724 May 19 13:55:53.242248 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 155/303] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:52 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:53.666553 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-10336e4e-e3a8-435a-a82c-4b79a9c00e01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:53.683478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-10336e4e-e3a8-435a-a82c-4b79a9c00e01 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1314 microversion: 2.1 time: 0.669010 May 19 13:55:53.684000 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 149/304] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:53 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:54.259871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-166398d5-df0f-4511-87b3-93a5bf06f4f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:54.260507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-166398d5-df0f-4511-87b3-93a5bf06f4f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:54.267419 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-166398d5-df0f-4511-87b3-93a5bf06f4f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:54.267858 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-166398d5-df0f-4511-87b3-93a5bf06f4f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:54.268787 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-166398d5-df0f-4511-87b3-93a5bf06f4f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:54.269374 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-166398d5-df0f-4511-87b3-93a5bf06f4f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:54.434367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-166398d5-df0f-4511-87b3-93a5bf06f4f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:54.445062 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-166398d5-df0f-4511-87b3-93a5bf06f4f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.189527 May 19 13:55:54.446049 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 156/305] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:54 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:54.699987 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c796e830-8b4b-4e40-b8cb-fa90707affb5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:54.701962 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c796e830-8b4b-4e40-b8cb-fa90707affb5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:54.708430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c796e830-8b4b-4e40-b8cb-fa90707affb5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:54.709123 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c796e830-8b4b-4e40-b8cb-fa90707affb5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:54.709714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c796e830-8b4b-4e40-b8cb-fa90707affb5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:54.710151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c796e830-8b4b-4e40-b8cb-fa90707affb5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:54.729297 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:54.790272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:54.812994 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=6 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:54.857204 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c796e830-8b4b-4e40-b8cb-fa90707affb5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:54.865891 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c796e830-8b4b-4e40-b8cb-fa90707affb5 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1314 microversion: 2.1 time: 0.169618 May 19 13:55:54.866779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 150/306] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:54 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:55.464099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-87fdc30b-08fd-43d7-9da3-444fe9246248 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:55.464549 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-87fdc30b-08fd-43d7-9da3-444fe9246248 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:55.467076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:55.478418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-87fdc30b-08fd-43d7-9da3-444fe9246248 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:55.478418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-87fdc30b-08fd-43d7-9da3-444fe9246248 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:55.484164 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-87fdc30b-08fd-43d7-9da3-444fe9246248 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:55.485390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-87fdc30b-08fd-43d7-9da3-444fe9246248 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:55.757369 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-87fdc30b-08fd-43d7-9da3-444fe9246248 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:55.770204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-87fdc30b-08fd-43d7-9da3-444fe9246248 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.310719 May 19 13:55:55.770794 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 157/307] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:55 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:55.886296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-37bf3bb1-8d63-4771-8dcc-2a5e67813d1b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:55.888622 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-37bf3bb1-8d63-4771-8dcc-2a5e67813d1b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:55.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:55.900479 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37bf3bb1-8d63-4771-8dcc-2a5e67813d1b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:55.901194 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37bf3bb1-8d63-4771-8dcc-2a5e67813d1b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:55.902156 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37bf3bb1-8d63-4771-8dcc-2a5e67813d1b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:55.902896 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37bf3bb1-8d63-4771-8dcc-2a5e67813d1b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:56.063226 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-37bf3bb1-8d63-4771-8dcc-2a5e67813d1b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:56.071662 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-37bf3bb1-8d63-4771-8dcc-2a5e67813d1b tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1314 microversion: 2.1 time: 0.191734 May 19 13:55:56.072426 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 151/308] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:55 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:56.787097 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1666e9e0-63da-4e6d-b743-ff9d0928bed4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:56.787858 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1666e9e0-63da-4e6d-b743-ff9d0928bed4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:56.793869 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1666e9e0-63da-4e6d-b743-ff9d0928bed4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:56.794491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1666e9e0-63da-4e6d-b743-ff9d0928bed4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:56.795385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1666e9e0-63da-4e6d-b743-ff9d0928bed4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:56.795828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1666e9e0-63da-4e6d-b743-ff9d0928bed4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:56.948268 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1666e9e0-63da-4e6d-b743-ff9d0928bed4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:56.959230 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1666e9e0-63da-4e6d-b743-ff9d0928bed4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.175764 May 19 13:55:56.959965 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 158/309] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:56 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:57.094301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-662968e2-3b4a-43d4-b204-cfb99210e4a7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:57.095840 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-662968e2-3b4a-43d4-b204-cfb99210e4a7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:57.115655 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-662968e2-3b4a-43d4-b204-cfb99210e4a7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:57.116358 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-662968e2-3b4a-43d4-b204-cfb99210e4a7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:57.117667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-662968e2-3b4a-43d4-b204-cfb99210e4a7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:57.118339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-662968e2-3b4a-43d4-b204-cfb99210e4a7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:57.315345 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-662968e2-3b4a-43d4-b204-cfb99210e4a7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:57.323767 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-662968e2-3b4a-43d4-b204-cfb99210e4a7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1314 microversion: 2.1 time: 0.237889 May 19 13:55:57.324338 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 152/310] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:57 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:57.976942 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8166733f-d386-41f3-8e52-021d0e07abb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:57.977412 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8166733f-d386-41f3-8e52-021d0e07abb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:57.985448 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8166733f-d386-41f3-8e52-021d0e07abb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:57.985900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8166733f-d386-41f3-8e52-021d0e07abb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:57.987049 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8166733f-d386-41f3-8e52-021d0e07abb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:57.987556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8166733f-d386-41f3-8e52-021d0e07abb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:58.129387 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8166733f-d386-41f3-8e52-021d0e07abb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:58.139561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8166733f-d386-41f3-8e52-021d0e07abb2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.166677 May 19 13:55:58.149442 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 159/311] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:57 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:58.341429 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-805dfe55-ee7c-4eab-a5c7-a472d7a57d35 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:58.343195 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-805dfe55-ee7c-4eab-a5c7-a472d7a57d35 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:58.352032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-805dfe55-ee7c-4eab-a5c7-a472d7a57d35 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:58.352483 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-805dfe55-ee7c-4eab-a5c7-a472d7a57d35 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:58.353254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-805dfe55-ee7c-4eab-a5c7-a472d7a57d35 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:58.353685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-805dfe55-ee7c-4eab-a5c7-a472d7a57d35 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:58.510261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-805dfe55-ee7c-4eab-a5c7-a472d7a57d35 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:58.521912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-805dfe55-ee7c-4eab-a5c7-a472d7a57d35 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1314 microversion: 2.1 time: 0.184099 May 19 13:55:58.522603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 153/312] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:58 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:59.159953 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8d735c90-37e2-470e-9a58-58bcc45b71be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:59.160721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8d735c90-37e2-470e-9a58-58bcc45b71be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:59.165790 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=82 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:55:59.167832 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8d735c90-37e2-470e-9a58-58bcc45b71be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:59.168275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8d735c90-37e2-470e-9a58-58bcc45b71be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:59.169141 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8d735c90-37e2-470e-9a58-58bcc45b71be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:59.170384 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8d735c90-37e2-470e-9a58-58bcc45b71be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:59.406725 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8d735c90-37e2-470e-9a58-58bcc45b71be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:59.422922 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8d735c90-37e2-470e-9a58-58bcc45b71be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.270170 May 19 13:55:59.423272 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 160/313] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:59 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:59.540662 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e9efe20c-5fae-4dce-8dc0-90f07af15dde tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:55:59.543898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e9efe20c-5fae-4dce-8dc0-90f07af15dde tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:55:59.554256 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9efe20c-5fae-4dce-8dc0-90f07af15dde tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:59.554951 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9efe20c-5fae-4dce-8dc0-90f07af15dde tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:59.555912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9efe20c-5fae-4dce-8dc0-90f07af15dde tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:59.556352 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9efe20c-5fae-4dce-8dc0-90f07af15dde tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:59.709944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e9efe20c-5fae-4dce-8dc0-90f07af15dde tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:55:59.717350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-e78af1b6-1154-4e08-850b-85b908c47ec4 req-51b5f243-60c3-44b9-8b8f-18779e014d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e32c58-34e9-4c74-9370-09aea3a3a06f", "name": "network-vif-plugged", "status": "completed", "tag": "8ac901fd-8be2-4f40-b91e-de640ebcef79"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:55:59.719641 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e9efe20c-5fae-4dce-8dc0-90f07af15dde tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1314 microversion: 2.1 time: 0.184309 May 19 13:55:59.720540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 154/314] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:55:59 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:55:59.729119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-e78af1b6-1154-4e08-850b-85b908c47ec4 req-51b5f243-60c3-44b9-8b8f-18779e014d12 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:55:59.729611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-e78af1b6-1154-4e08-850b-85b908c47ec4 req-51b5f243-60c3-44b9-8b8f-18779e014d12 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:55:59.743852 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-e78af1b6-1154-4e08-850b-85b908c47ec4 req-51b5f243-60c3-44b9-8b8f-18779e014d12 service nova] Creating event network-vif-plugged:8ac901fd-8be2-4f40-b91e-de640ebcef79 for instance a7e32c58-34e9-4c74-9370-09aea3a3a06f on hv-cinder-78481 May 19 13:55:59.750174 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-e78af1b6-1154-4e08-850b-85b908c47ec4 req-51b5f243-60c3-44b9-8b8f-18779e014d12 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037383 May 19 13:55:59.751559 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 161/315] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:56:00.440356 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9ac76c24-9876-4080-8fb8-8e03f62e349d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:00.442521 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9ac76c24-9876-4080-8fb8-8e03f62e349d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:00.449794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ac76c24-9876-4080-8fb8-8e03f62e349d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:00.450840 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ac76c24-9876-4080-8fb8-8e03f62e349d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:00.452408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ac76c24-9876-4080-8fb8-8e03f62e349d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:00.452842 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ac76c24-9876-4080-8fb8-8e03f62e349d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:00.691032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9ac76c24-9876-4080-8fb8-8e03f62e349d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:00.705617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9ac76c24-9876-4080-8fb8-8e03f62e349d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.269575 May 19 13:56:00.706247 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 155/316] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:00 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:00.737515 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-869704db-1258-4536-835b-fcc135062767 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:00.738201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-869704db-1258-4536-835b-fcc135062767 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:00.745750 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-869704db-1258-4536-835b-fcc135062767 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:00.746200 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-869704db-1258-4536-835b-fcc135062767 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:00.749472 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-869704db-1258-4536-835b-fcc135062767 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:00.749949 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-869704db-1258-4536-835b-fcc135062767 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:00.925697 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-869704db-1258-4536-835b-fcc135062767 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:00.936061 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-869704db-1258-4536-835b-fcc135062767 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1314 microversion: 2.1 time: 0.202971 May 19 13:56:00.936871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 162/317] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:00 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:01.724697 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-06c7c3ed-186a-42b8-abe7-19649116e36e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:01.725312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-06c7c3ed-186a-42b8-abe7-19649116e36e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:01.733854 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-06c7c3ed-186a-42b8-abe7-19649116e36e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:01.733854 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-06c7c3ed-186a-42b8-abe7-19649116e36e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:01.734133 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-06c7c3ed-186a-42b8-abe7-19649116e36e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:01.734547 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-06c7c3ed-186a-42b8-abe7-19649116e36e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:01.886107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-06c7c3ed-186a-42b8-abe7-19649116e36e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:01.894978 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-06c7c3ed-186a-42b8-abe7-19649116e36e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.174734 May 19 13:56:01.895552 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 156/318] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:01 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:01.955020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3b2340c0-e542-4e27-9b2a-3e234f410241 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:01.955786 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3b2340c0-e542-4e27-9b2a-3e234f410241 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:01.962274 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3b2340c0-e542-4e27-9b2a-3e234f410241 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:01.963000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3b2340c0-e542-4e27-9b2a-3e234f410241 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:01.963955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3b2340c0-e542-4e27-9b2a-3e234f410241 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:01.964666 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3b2340c0-e542-4e27-9b2a-3e234f410241 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:02.140367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3b2340c0-e542-4e27-9b2a-3e234f410241 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:02.149234 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3b2340c0-e542-4e27-9b2a-3e234f410241 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1499 microversion: 2.1 time: 0.199605 May 19 13:56:02.150071 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 163/319] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:01 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1499 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:02.910323 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9b1c1368-eb54-4e21-8309-a2fbd426726e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:02.910924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9b1c1368-eb54-4e21-8309-a2fbd426726e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:02.911506 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-71dbc47d-4f29-4279-a782-d9fe8fd55263 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:02.912119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-71dbc47d-4f29-4279-a782-d9fe8fd55263 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:02.917372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b1c1368-eb54-4e21-8309-a2fbd426726e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:02.922225 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-71dbc47d-4f29-4279-a782-d9fe8fd55263 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:02.922674 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-71dbc47d-4f29-4279-a782-d9fe8fd55263 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:02.923475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-71dbc47d-4f29-4279-a782-d9fe8fd55263 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:02.923909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-71dbc47d-4f29-4279-a782-d9fe8fd55263 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:02.927861 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b1c1368-eb54-4e21-8309-a2fbd426726e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:02.928812 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b1c1368-eb54-4e21-8309-a2fbd426726e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:02.929263 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b1c1368-eb54-4e21-8309-a2fbd426726e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:02.956528 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9b1c1368-eb54-4e21-8309-a2fbd426726e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:56:03.054453 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9b1c1368-eb54-4e21-8309-a2fbd426726e tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 204 len: 0 microversion: 2.1 time: 0.145403 May 19 13:56:03.055076 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 157/320] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:56:02 2022] DELETE /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:56:03.072305 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7d70b1b4-497f-430c-b2bb-75c4795e321c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:03.073524 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7d70b1b4-497f-430c-b2bb-75c4795e321c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:03.080679 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d70b1b4-497f-430c-b2bb-75c4795e321c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:03.081127 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d70b1b4-497f-430c-b2bb-75c4795e321c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:03.082012 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d70b1b4-497f-430c-b2bb-75c4795e321c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:03.082544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d70b1b4-497f-430c-b2bb-75c4795e321c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:03.103333 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-71dbc47d-4f29-4279-a782-d9fe8fd55263 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:03.113790 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-71dbc47d-4f29-4279-a782-d9fe8fd55263 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.205924 May 19 13:56:03.125475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 164/321] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:02 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:03.241600 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7d70b1b4-497f-430c-b2bb-75c4795e321c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:03.249845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7d70b1b4-497f-430c-b2bb-75c4795e321c tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1505 microversion: 2.1 time: 0.187032 May 19 13:56:03.250514 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 158/322] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:03 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:56:04.133634 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-19ff550f-636f-4465-b749-ffe8c0bdc065 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:04.134427 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-19ff550f-636f-4465-b749-ffe8c0bdc065 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:04.141581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-19ff550f-636f-4465-b749-ffe8c0bdc065 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:04.142132 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-19ff550f-636f-4465-b749-ffe8c0bdc065 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:04.142923 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-19ff550f-636f-4465-b749-ffe8c0bdc065 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:04.143378 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-19ff550f-636f-4465-b749-ffe8c0bdc065 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:04.268890 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c52879ab-cde3-4a11-a9c8-11dbd55fb258 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:04.270242 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c52879ab-cde3-4a11-a9c8-11dbd55fb258 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:04.279236 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c52879ab-cde3-4a11-a9c8-11dbd55fb258 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:04.280622 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c52879ab-cde3-4a11-a9c8-11dbd55fb258 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:04.281700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c52879ab-cde3-4a11-a9c8-11dbd55fb258 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:04.282423 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c52879ab-cde3-4a11-a9c8-11dbd55fb258 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:04.290825 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-19ff550f-636f-4465-b749-ffe8c0bdc065 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:04.301853 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-19ff550f-636f-4465-b749-ffe8c0bdc065 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.172162 May 19 13:56:04.311542 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 165/323] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:04 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:04.434040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c52879ab-cde3-4a11-a9c8-11dbd55fb258 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:04.442066 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c52879ab-cde3-4a11-a9c8-11dbd55fb258 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1505 microversion: 2.1 time: 0.178725 May 19 13:56:04.442628 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 159/324] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:04 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:56:05.319788 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7e72daec-2d76-4d01-a515-0deda5cedb79 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:05.320528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7e72daec-2d76-4d01-a515-0deda5cedb79 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:05.327218 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e72daec-2d76-4d01-a515-0deda5cedb79 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:05.327770 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e72daec-2d76-4d01-a515-0deda5cedb79 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:05.328602 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e72daec-2d76-4d01-a515-0deda5cedb79 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:05.329055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e72daec-2d76-4d01-a515-0deda5cedb79 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:05.459688 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5435caff-76c9-4c36-ad73-4e152bcdab7d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:05.460299 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5435caff-76c9-4c36-ad73-4e152bcdab7d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:05.467569 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5435caff-76c9-4c36-ad73-4e152bcdab7d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:05.468021 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5435caff-76c9-4c36-ad73-4e152bcdab7d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:05.468973 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5435caff-76c9-4c36-ad73-4e152bcdab7d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:05.469552 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5435caff-76c9-4c36-ad73-4e152bcdab7d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:05.483058 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7e72daec-2d76-4d01-a515-0deda5cedb79 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:05.490883 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7e72daec-2d76-4d01-a515-0deda5cedb79 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.175431 May 19 13:56:05.491718 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 166/325] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:05 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:05.650889 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5435caff-76c9-4c36-ad73-4e152bcdab7d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:05.660308 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5435caff-76c9-4c36-ad73-4e152bcdab7d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1505 microversion: 2.1 time: 0.204493 May 19 13:56:05.660887 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 160/326] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:05 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:56:06.510436 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7067c2f5-aa95-4e5b-af08-46b9d94ab060 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:06.511210 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7067c2f5-aa95-4e5b-af08-46b9d94ab060 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:06.521958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7067c2f5-aa95-4e5b-af08-46b9d94ab060 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:06.522402 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7067c2f5-aa95-4e5b-af08-46b9d94ab060 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:06.523193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7067c2f5-aa95-4e5b-af08-46b9d94ab060 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:06.527819 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7067c2f5-aa95-4e5b-af08-46b9d94ab060 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:06.661157 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7067c2f5-aa95-4e5b-af08-46b9d94ab060 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:06.668979 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7067c2f5-aa95-4e5b-af08-46b9d94ab060 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.162164 May 19 13:56:06.680453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 167/327] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:06 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:06.687427 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a54d595c-4e8f-47f1-9d54-817a0d7fa0e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:06.688071 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a54d595c-4e8f-47f1-9d54-817a0d7fa0e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:06.696478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a54d595c-4e8f-47f1-9d54-817a0d7fa0e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:06.696927 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a54d595c-4e8f-47f1-9d54-817a0d7fa0e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:06.697693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a54d595c-4e8f-47f1-9d54-817a0d7fa0e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:06.698122 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a54d595c-4e8f-47f1-9d54-817a0d7fa0e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:06.840594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a54d595c-4e8f-47f1-9d54-817a0d7fa0e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:06.848676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a54d595c-4e8f-47f1-9d54-817a0d7fa0e7 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1505 microversion: 2.1 time: 0.165826 May 19 13:56:06.849459 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 161/328] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:06 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:07.689152 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-60bc167b-4b62-4ef7-9b18-30e766decda1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:07.689633 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-60bc167b-4b62-4ef7-9b18-30e766decda1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:07.695755 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-60bc167b-4b62-4ef7-9b18-30e766decda1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:07.696201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-60bc167b-4b62-4ef7-9b18-30e766decda1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:07.696963 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-60bc167b-4b62-4ef7-9b18-30e766decda1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:07.697395 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-60bc167b-4b62-4ef7-9b18-30e766decda1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:07.837926 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-60bc167b-4b62-4ef7-9b18-30e766decda1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:07.845374 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-60bc167b-4b62-4ef7-9b18-30e766decda1 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.161338 May 19 13:56:07.845933 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 168/329] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:07 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:07.865956 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7c9b719f-01e2-4bce-bc6f-a723e19f147d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:07.866683 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7c9b719f-01e2-4bce-bc6f-a723e19f147d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:07.873610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7c9b719f-01e2-4bce-bc6f-a723e19f147d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:07.874079 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7c9b719f-01e2-4bce-bc6f-a723e19f147d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:07.874909 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7c9b719f-01e2-4bce-bc6f-a723e19f147d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:07.875353 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7c9b719f-01e2-4bce-bc6f-a723e19f147d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:08.051555 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7c9b719f-01e2-4bce-bc6f-a723e19f147d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:08.060031 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7c9b719f-01e2-4bce-bc6f-a723e19f147d tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1505 microversion: 2.1 time: 0.198412 May 19 13:56:08.061156 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 162/330] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:07 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:08.549904 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-888dfb59-4c74-464b-9241-ffd4fe70d91a req-d5b2ec76-d8d5-4ba3-afa7-438c2db5e1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7e32c58-34e9-4c74-9370-09aea3a3a06f", "name": "network-vif-deleted", "tag": "8ac901fd-8be2-4f40-b91e-de640ebcef79"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:08.563139 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-888dfb59-4c74-464b-9241-ffd4fe70d91a req-d5b2ec76-d8d5-4ba3-afa7-438c2db5e1f3 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:08.563899 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-888dfb59-4c74-464b-9241-ffd4fe70d91a req-d5b2ec76-d8d5-4ba3-afa7-438c2db5e1f3 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:08.576989 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-888dfb59-4c74-464b-9241-ffd4fe70d91a req-d5b2ec76-d8d5-4ba3-afa7-438c2db5e1f3 service nova] Creating event network-vif-deleted:8ac901fd-8be2-4f40-b91e-de640ebcef79 for instance a7e32c58-34e9-4c74-9370-09aea3a3a06f on hv-cinder-78481 May 19 13:56:08.583202 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-888dfb59-4c74-464b-9241-ffd4fe70d91a req-d5b2ec76-d8d5-4ba3-afa7-438c2db5e1f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038599 May 19 13:56:08.584332 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 169/331] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:56:08.863631 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b59a9071-31c8-4369-9e91-2470197d6e78 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:08.863631 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b59a9071-31c8-4369-9e91-2470197d6e78 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:08.871997 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b59a9071-31c8-4369-9e91-2470197d6e78 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:08.872639 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b59a9071-31c8-4369-9e91-2470197d6e78 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:08.873678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b59a9071-31c8-4369-9e91-2470197d6e78 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:08.874715 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b59a9071-31c8-4369-9e91-2470197d6e78 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:09.015382 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b59a9071-31c8-4369-9e91-2470197d6e78 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:09.022816 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b59a9071-31c8-4369-9e91-2470197d6e78 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.164970 May 19 13:56:09.023395 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 163/332] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:08 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:09.085493 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:09.085493 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:09.085493 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:09.086084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:09.087020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:09.087020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:09.119408 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:09.119869 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:09.120307 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lazy-loading 'fault' on Instance uuid a7e32c58-34e9-4c74-9370-09aea3a3a06f {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:56:09.163831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9a3080f9aef4323952eed19ef9bb074', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fe46ffac52d412daf3663e2ab1273de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:09.172632 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-877619db-e032-4626-b6cd-58db081a18ea tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 200 len: 1304 microversion: 2.1 time: 0.099160 May 19 13:56:09.173203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 170/333] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:09 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:10.039746 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-65b7b296-8780-4c83-9bf7-513f6f4aa193 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:10.040391 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-65b7b296-8780-4c83-9bf7-513f6f4aa193 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:10.047026 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-65b7b296-8780-4c83-9bf7-513f6f4aa193 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:10.047478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-65b7b296-8780-4c83-9bf7-513f6f4aa193 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:10.048247 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-65b7b296-8780-4c83-9bf7-513f6f4aa193 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:10.048728 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-65b7b296-8780-4c83-9bf7-513f6f4aa193 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:10.178953 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-65b7b296-8780-4c83-9bf7-513f6f4aa193 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:10.187198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-65b7b296-8780-4c83-9bf7-513f6f4aa193 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.150544 May 19 13:56:10.187767 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 164/334] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:10 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:10.189864 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:10.190468 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] [instance: a7e32c58-34e9-4c74-9370-09aea3a3a06f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:10.196344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:10.196774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:10.197573 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:10.198034 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:10.213593 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] HTTP exception thrown: Instance a7e32c58-34e9-4c74-9370-09aea3a3a06f could not be found. May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Request method failure captured: May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f HTTP/1.1 May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwl8I61l79dO2bRyl6NxXstAAe1Sx_YIIq8gu9dF3dwENSL_A-PHTYsttCnrNQsvajRGaYsEhuuQ-WbMK3v_-AtJNmv1t-7TPz_vkZudgQAe0B8aKINswHMU0_3-2v8--nUX31KSSiknEao-3gE2twkuRA_SbE9VOz0D3Zk0ARq8KQ May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 4fe46ffac52d412daf3663e2ab1273de May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesActionsTest-47775183 May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:56:10.215185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4fe46ffac52d412daf3663e2ab1273de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fe46ffac52d412daf3663e2ab1273de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4fe46ffac52d412daf3663e2ab1273de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4fe46ffac52d412daf3663e2ab1273de"}]}] May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesActionsTest-47775183 May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 4fe46ffac52d412daf3663e2ab1273de May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesActionsTest-47775183 May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesActionsTest-47775183-project May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: a9a3080f9aef4323952eed19ef9bb074 May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesActionsTest-47775183-project May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance a7e32c58-34e9-4c74-9370-09aea3a3a06f could not be found. May 19 13:56:10.216613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': 'a7e32c58-34e9-4c74-9370-09aea3a3a06f'} May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7e32c58-34e9-4c74-9370-09aea3a3a06f could not be found. May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:56:10.217400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7e32c58-34e9-4c74-9370-09aea3a3a06f could not be found. May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7e32c58-34e9-4c74-9370-09aea3a3a06f could not be found. May 19 13:56:10.218540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:56:10.219587 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] Returning 404 to user: Instance a7e32c58-34e9-4c74-9370-09aea3a3a06f could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:56:10.219587 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-67b76677-4e1e-4aee-bc04-ac99b0d0c196 tempest-VolumesActionsTest-47775183 tempest-VolumesActionsTest-47775183-project] 10.222.0.52 "GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f" status: 404 len: 111 microversion: 2.1 time: 0.031039 May 19 13:56:10.219587 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 171/335] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:10 2022] GET /compute/v2.1/servers/a7e32c58-34e9-4c74-9370-09aea3a3a06f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 13:56:11.204485 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ef28b474-730b-40c1-a3e9-830f9bdf297a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:11.205109 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ef28b474-730b-40c1-a3e9-830f9bdf297a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:11.212780 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef28b474-730b-40c1-a3e9-830f9bdf297a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:11.213223 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef28b474-730b-40c1-a3e9-830f9bdf297a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:11.213983 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef28b474-730b-40c1-a3e9-830f9bdf297a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:11.214414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef28b474-730b-40c1-a3e9-830f9bdf297a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:11.230300 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:11.344146 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ef28b474-730b-40c1-a3e9-830f9bdf297a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:11.351590 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ef28b474-730b-40c1-a3e9-830f9bdf297a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.151662 May 19 13:56:11.352150 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 165/336] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:11 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:56:12.368455 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3dd06b28-4a86-4661-aa97-26aa5a94b168 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:12.369064 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3dd06b28-4a86-4661-aa97-26aa5a94b168 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:12.375303 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3dd06b28-4a86-4661-aa97-26aa5a94b168 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:12.375694 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3dd06b28-4a86-4661-aa97-26aa5a94b168 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:12.376450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3dd06b28-4a86-4661-aa97-26aa5a94b168 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:12.376883 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3dd06b28-4a86-4661-aa97-26aa5a94b168 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:12.508235 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3dd06b28-4a86-4661-aa97-26aa5a94b168 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:12.516128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3dd06b28-4a86-4661-aa97-26aa5a94b168 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.151558 May 19 13:56:12.516691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 172/337] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:12 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:13.533676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-deabf1fd-00a3-4b05-9b65-1d8789fcbd67 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:13.534329 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-deabf1fd-00a3-4b05-9b65-1d8789fcbd67 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:13.542386 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-deabf1fd-00a3-4b05-9b65-1d8789fcbd67 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:13.542835 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-deabf1fd-00a3-4b05-9b65-1d8789fcbd67 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:13.543931 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-deabf1fd-00a3-4b05-9b65-1d8789fcbd67 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:13.544387 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-deabf1fd-00a3-4b05-9b65-1d8789fcbd67 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:13.709123 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-deabf1fd-00a3-4b05-9b65-1d8789fcbd67 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:13.721401 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-deabf1fd-00a3-4b05-9b65-1d8789fcbd67 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.192231 May 19 13:56:13.731008 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 166/338] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:13 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:14.738143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c7f35cc4-164f-4768-a099-36c676908d52 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:14.738754 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c7f35cc4-164f-4768-a099-36c676908d52 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:14.744806 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c7f35cc4-164f-4768-a099-36c676908d52 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:14.745256 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c7f35cc4-164f-4768-a099-36c676908d52 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:14.746011 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c7f35cc4-164f-4768-a099-36c676908d52 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:14.746448 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c7f35cc4-164f-4768-a099-36c676908d52 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:14.877513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c7f35cc4-164f-4768-a099-36c676908d52 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:14.880125 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:14.887224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c7f35cc4-164f-4768-a099-36c676908d52 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.153538 May 19 13:56:14.887896 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 173/339] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:14 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:15.907133 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0888b107-8535-48a6-ab9a-563b08c136c2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:15.907739 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0888b107-8535-48a6-ab9a-563b08c136c2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:15.915344 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0888b107-8535-48a6-ab9a-563b08c136c2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:15.915791 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0888b107-8535-48a6-ab9a-563b08c136c2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:15.916556 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0888b107-8535-48a6-ab9a-563b08c136c2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:15.916988 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0888b107-8535-48a6-ab9a-563b08c136c2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:16.066715 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0888b107-8535-48a6-ab9a-563b08c136c2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:16.074654 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0888b107-8535-48a6-ab9a-563b08c136c2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.173029 May 19 13:56:16.075250 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 167/340] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:15 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:17.091596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-136d33f2-2596-40c0-9c63-0c4dc752d00a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:17.092221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-136d33f2-2596-40c0-9c63-0c4dc752d00a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:17.098422 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-136d33f2-2596-40c0-9c63-0c4dc752d00a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:17.098897 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-136d33f2-2596-40c0-9c63-0c4dc752d00a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:17.099693 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-136d33f2-2596-40c0-9c63-0c4dc752d00a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:17.100113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-136d33f2-2596-40c0-9c63-0c4dc752d00a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:17.234069 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-136d33f2-2596-40c0-9c63-0c4dc752d00a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:17.241582 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-136d33f2-2596-40c0-9c63-0c4dc752d00a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.153904 May 19 13:56:17.242138 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 174/341] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:17 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:18.258021 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0b836604-2767-4bc9-b3b4-9ed47c7eaf87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:18.258567 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0b836604-2767-4bc9-b3b4-9ed47c7eaf87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:18.265278 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b836604-2767-4bc9-b3b4-9ed47c7eaf87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:18.266286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b836604-2767-4bc9-b3b4-9ed47c7eaf87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:18.267211 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b836604-2767-4bc9-b3b4-9ed47c7eaf87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:18.267642 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0b836604-2767-4bc9-b3b4-9ed47c7eaf87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:18.412324 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0b836604-2767-4bc9-b3b4-9ed47c7eaf87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:18.419714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0b836604-2767-4bc9-b3b4-9ed47c7eaf87 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.165998 May 19 13:56:18.420279 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 168/342] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:18 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:19.437153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-df13b079-3f33-49ce-bb13-a674abef6552 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:19.437837 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-df13b079-3f33-49ce-bb13-a674abef6552 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:19.444953 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-df13b079-3f33-49ce-bb13-a674abef6552 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:19.445397 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-df13b079-3f33-49ce-bb13-a674abef6552 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:19.446170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-df13b079-3f33-49ce-bb13-a674abef6552 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:19.446604 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-df13b079-3f33-49ce-bb13-a674abef6552 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:19.575106 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-df13b079-3f33-49ce-bb13-a674abef6552 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:19.583431 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-df13b079-3f33-49ce-bb13-a674abef6552 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.150193 May 19 13:56:19.583996 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 175/343] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:19 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:20.603438 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d622541f-0b4c-4eee-80b7-e82730ee05f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:20.604467 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d622541f-0b4c-4eee-80b7-e82730ee05f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:20.615114 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d622541f-0b4c-4eee-80b7-e82730ee05f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:20.615856 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d622541f-0b4c-4eee-80b7-e82730ee05f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:20.617088 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d622541f-0b4c-4eee-80b7-e82730ee05f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:20.617716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d622541f-0b4c-4eee-80b7-e82730ee05f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:20.949849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d622541f-0b4c-4eee-80b7-e82730ee05f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:20.957380 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d622541f-0b4c-4eee-80b7-e82730ee05f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.360528 May 19 13:56:20.957933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 169/344] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:20 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:21.974137 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d714e40d-ec80-4069-9850-120224e837f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:21.974751 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d714e40d-ec80-4069-9850-120224e837f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:21.980897 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d714e40d-ec80-4069-9850-120224e837f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:21.981345 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d714e40d-ec80-4069-9850-120224e837f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:21.982106 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d714e40d-ec80-4069-9850-120224e837f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:21.982539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d714e40d-ec80-4069-9850-120224e837f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:22.115552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d714e40d-ec80-4069-9850-120224e837f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:22.123085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d714e40d-ec80-4069-9850-120224e837f6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.153043 May 19 13:56:22.123641 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 176/345] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:21 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:23.140293 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-84ac913f-f3a9-4298-9b7a-715ee83a1b4a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:23.140901 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-84ac913f-f3a9-4298-9b7a-715ee83a1b4a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:23.147889 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84ac913f-f3a9-4298-9b7a-715ee83a1b4a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:23.148332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84ac913f-f3a9-4298-9b7a-715ee83a1b4a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:23.149087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84ac913f-f3a9-4298-9b7a-715ee83a1b4a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:23.149522 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84ac913f-f3a9-4298-9b7a-715ee83a1b4a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:23.280227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-84ac913f-f3a9-4298-9b7a-715ee83a1b4a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:23.288859 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-84ac913f-f3a9-4298-9b7a-715ee83a1b4a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.152347 May 19 13:56:23.289424 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 170/346] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:23 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:24.305602 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8b8c7834-32b9-413c-89e0-d58a5f97dcce tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:24.306228 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8b8c7834-32b9-413c-89e0-d58a5f97dcce tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:24.312232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8b8c7834-32b9-413c-89e0-d58a5f97dcce tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:24.312678 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8b8c7834-32b9-413c-89e0-d58a5f97dcce tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:24.313455 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8b8c7834-32b9-413c-89e0-d58a5f97dcce tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:24.313871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8b8c7834-32b9-413c-89e0-d58a5f97dcce tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:24.510923 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8b8c7834-32b9-413c-89e0-d58a5f97dcce tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:24.519737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8b8c7834-32b9-413c-89e0-d58a5f97dcce tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.218120 May 19 13:56:24.520536 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 177/347] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:24 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:25.537681 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-19cc800b-3f71-4ef9-8ad9-e4202d15eccb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:25.538303 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-19cc800b-3f71-4ef9-8ad9-e4202d15eccb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:25.544559 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19cc800b-3f71-4ef9-8ad9-e4202d15eccb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:25.545002 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19cc800b-3f71-4ef9-8ad9-e4202d15eccb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:25.545787 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19cc800b-3f71-4ef9-8ad9-e4202d15eccb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:25.546205 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19cc800b-3f71-4ef9-8ad9-e4202d15eccb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:25.679888 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-19cc800b-3f71-4ef9-8ad9-e4202d15eccb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:25.688931 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-19cc800b-3f71-4ef9-8ad9-e4202d15eccb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.154940 May 19 13:56:25.691420 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 171/348] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:25 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:26.707930 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-02720843-2b35-4bb5-a0fd-6168c3f420f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:26.708669 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-02720843-2b35-4bb5-a0fd-6168c3f420f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:26.715301 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-02720843-2b35-4bb5-a0fd-6168c3f420f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:26.715877 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-02720843-2b35-4bb5-a0fd-6168c3f420f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:26.716765 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-02720843-2b35-4bb5-a0fd-6168c3f420f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:26.717275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-02720843-2b35-4bb5-a0fd-6168c3f420f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:26.964427 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-02720843-2b35-4bb5-a0fd-6168c3f420f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:26.974362 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-02720843-2b35-4bb5-a0fd-6168c3f420f0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1499 microversion: 2.1 time: 0.271050 May 19 13:56:26.987361 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 178/349] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:26 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1499 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:26.992514 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a14bf6cd-dbb4-4022-8190-d5cee4293060"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:26.993743 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:26.997797 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:27.003027 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:27.003749 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:27.005131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:27.005821 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:27.045899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] HTTP exception thrown: Cannot 'attach_volume' instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 while it is in vm_state rescued May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Request method failure captured: May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: POST /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516/os-volume_attachments HTTP/1.1 May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 74 May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwR8hzgIQIvgXeEM5L2dMhVxvBFzRTgSVN6ic_FVvk5L-iPskc47LcpgVydeVUCvM0x7XfiA91dw9McFpEV16_PqPrAs7WDyu_9PxCp_2nJTUBv4popy6qF1P2_PDF8M1xIqMvUfN4G_EW0aX6yCiNb6CHv7jCtLFHzhW1M2f-GVSU May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:56:27.054173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}] May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: 698ccea06fb24beea18c679d53f907a6 May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {"volumeAttachment": {"volumeId": "a14bf6cd-dbb4-4022-8190-d5cee4293060"}} May 19 13:56:27.055737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Cannot 'attach_volume' instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 while it is in vm_state rescued May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'server_id': '2b0a5331-be2a-4c5b-80ac-6be7220f2516', 'body': {'volumeAttachment': {'volumeId': 'a14bf6cd-dbb4-4022-8190-d5cee4293060'}}} May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:56:27.056493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 while it is in vm_state rescued May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:56:27.057563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:56:27.058716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:56:27.058716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:56:27.058716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 while it is in vm_state rescued May 19 13:56:27.058716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:56:27.058716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Returning 409 to user: Cannot 'attach_volume' instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 while it is in vm_state rescued {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:56:27.058716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-38d8b36e-4f45-44bd-9387-fa03912d7f10 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.070391 May 19 13:56:27.059541 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 172/350] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 13:56:26 2022] POST /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 19 13:56:27.068909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-02c26e86-610b-4a19-a9aa-b344dd8bbd0b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:27.069432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-02c26e86-610b-4a19-a9aa-b344dd8bbd0b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:27.075827 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-02c26e86-610b-4a19-a9aa-b344dd8bbd0b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:27.076541 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-02c26e86-610b-4a19-a9aa-b344dd8bbd0b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:27.077764 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-02c26e86-610b-4a19-a9aa-b344dd8bbd0b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:27.078407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-02c26e86-610b-4a19-a9aa-b344dd8bbd0b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:27.163266 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-02c26e86-610b-4a19-a9aa-b344dd8bbd0b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516/action" status: 202 len: 0 microversion: 2.1 time: 0.098290 May 19 13:56:27.167043 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 179/351] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 13:56:27 2022] POST /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:56:27.176659 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-98f089fe-8ccf-438b-88bb-13ca23d7f734 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:27.177403 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-98f089fe-8ccf-438b-88bb-13ca23d7f734 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:27.193742 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98f089fe-8ccf-438b-88bb-13ca23d7f734 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:27.195184 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98f089fe-8ccf-438b-88bb-13ca23d7f734 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:27.197122 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98f089fe-8ccf-438b-88bb-13ca23d7f734 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:27.198073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98f089fe-8ccf-438b-88bb-13ca23d7f734 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:27.620116 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98f089fe-8ccf-438b-88bb-13ca23d7f734 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:27.629477 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-98f089fe-8ccf-438b-88bb-13ca23d7f734 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1507 microversion: 2.1 time: 0.458837 May 19 13:56:27.638822 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 173/352] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:27 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1507 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:28.648527 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ab53c78e-6db2-478a-9194-0f009c6d8eb9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:28.650279 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ab53c78e-6db2-478a-9194-0f009c6d8eb9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:28.662098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ab53c78e-6db2-478a-9194-0f009c6d8eb9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:28.662556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ab53c78e-6db2-478a-9194-0f009c6d8eb9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:28.663366 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ab53c78e-6db2-478a-9194-0f009c6d8eb9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:28.664404 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ab53c78e-6db2-478a-9194-0f009c6d8eb9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:28.820691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ab53c78e-6db2-478a-9194-0f009c6d8eb9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:28.832452 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ab53c78e-6db2-478a-9194-0f009c6d8eb9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1507 microversion: 2.1 time: 0.189545 May 19 13:56:28.833049 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 180/353] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:28 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1507 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:29.849087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1e9c1a46-d9ec-442a-86be-394a1646b24b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:29.849707 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1e9c1a46-d9ec-442a-86be-394a1646b24b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:29.858008 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e9c1a46-d9ec-442a-86be-394a1646b24b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:29.858719 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e9c1a46-d9ec-442a-86be-394a1646b24b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:29.859676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e9c1a46-d9ec-442a-86be-394a1646b24b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:29.860882 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e9c1a46-d9ec-442a-86be-394a1646b24b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:30.031260 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1e9c1a46-d9ec-442a-86be-394a1646b24b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:30.041493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1e9c1a46-d9ec-442a-86be-394a1646b24b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1507 microversion: 2.1 time: 0.196294 May 19 13:56:30.042235 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 174/354] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:29 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:31.059477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d1034ab3-1d45-4f50-a1c5-68db7bee4a05 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:31.060146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d1034ab3-1d45-4f50-a1c5-68db7bee4a05 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:31.062198 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=44 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:31.067959 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d1034ab3-1d45-4f50-a1c5-68db7bee4a05 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:31.068390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d1034ab3-1d45-4f50-a1c5-68db7bee4a05 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:31.069359 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d1034ab3-1d45-4f50-a1c5-68db7bee4a05 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:31.069949 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d1034ab3-1d45-4f50-a1c5-68db7bee4a05 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:31.256025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d1034ab3-1d45-4f50-a1c5-68db7bee4a05 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:31.263861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d1034ab3-1d45-4f50-a1c5-68db7bee4a05 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1507 microversion: 2.1 time: 0.208595 May 19 13:56:31.265004 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 181/355] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:31 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:32.281574 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cf45f2af-ed58-4080-841f-4680e7f1166d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:32.283032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cf45f2af-ed58-4080-841f-4680e7f1166d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:32.289460 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf45f2af-ed58-4080-841f-4680e7f1166d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:32.289916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf45f2af-ed58-4080-841f-4680e7f1166d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:32.290690 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf45f2af-ed58-4080-841f-4680e7f1166d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:32.291156 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf45f2af-ed58-4080-841f-4680e7f1166d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:32.453244 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cf45f2af-ed58-4080-841f-4680e7f1166d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:32.462390 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cf45f2af-ed58-4080-841f-4680e7f1166d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1513 microversion: 2.1 time: 0.184545 May 19 13:56:32.463183 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 175/356] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:32 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:33.983697 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-360eb471-e692-41ca-8c8f-71b08e732f57 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:33.984818 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-360eb471-e692-41ca-8c8f-71b08e732f57 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:33.992911 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-360eb471-e692-41ca-8c8f-71b08e732f57 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:33.993591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-360eb471-e692-41ca-8c8f-71b08e732f57 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:33.994684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-360eb471-e692-41ca-8c8f-71b08e732f57 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:33.995371 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-360eb471-e692-41ca-8c8f-71b08e732f57 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:34.022641 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-360eb471-e692-41ca-8c8f-71b08e732f57 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/ips" status: 200 len: 151 microversion: 2.20 time: 0.043281 May 19 13:56:34.030608 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 182/357] 10.222.0.52 () {60 vars in 1288 bytes} [Thu May 19 13:56:33 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:56:34.114071 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-28dab72e-7f12-4884-afb4-c9ea6bd06468 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'create', calling method: .version_select at 0x7f5de1e17dc0>, body: {"keypair": {"name": "tempest-keypair-915409444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZQGc3+6w+5b7NVZtIVnjx7tusJ1uBjziZV91ONAITt81U+XrnZ2MF6W8Y/SgRRHFQKxqM11fpPY/wDrEOU8Y4RLMO+d2E+4xJbt4c0PMbg+Az/tHDmHBqcjT086uE8wQ=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:34.132145 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-28dab72e-7f12-4884-afb4-c9ea6bd06468 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Getting quotas for project 28027af4cc0c4ca99035e48aa6237805. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:56:34.137004 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-28dab72e-7f12-4884-afb4-c9ea6bd06468 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Getting quotas for user 698ccea06fb24beea18c679d53f907a6 and project 28027af4cc0c4ca99035e48aa6237805. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:56:34.169856 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-28dab72e-7f12-4884-afb4-c9ea6bd06468 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064746 May 19 13:56:34.178246 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 176/358] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 13:56:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:56:36.925552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-978673120", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34a01e8b-7928-4301-ae0a-d1e9be21f258"}], "security_groups": [{"name": "tempest-securitygroup--921132183"}], "key_name": "tempest-keypair-915409444", "user_data": "}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:37.128180 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] validate_networks() for [('34a01e8b-7928-4301-ae0a-d1e9be21f258', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:56:37.858141 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:56:37.858556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:56:37.862070 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:56:37.862512 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:56:37.862954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:56:37.892231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:37.892822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:37.893709 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:37.894143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:37.945632 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Getting quotas for project 28027af4cc0c4ca99035e48aa6237805. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:56:37.956002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Getting quotas for user 698ccea06fb24beea18c679d53f907a6 and project 28027af4cc0c4ca99035e48aa6237805. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:56:37.978069 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:56:37.983658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:56:38.094078 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-dce2873f-062f-431c-a092-c35ff8ccf123 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.173979 May 19 13:56:38.095897 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 183/359] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:56:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 1176 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:56:38.107889 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-65bd8411-3be5-4314-81df-e1431ac6b956 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:38.108885 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-65bd8411-3be5-4314-81df-e1431ac6b956 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:38.208615 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-65bd8411-3be5-4314-81df-e1431ac6b956 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:38.224450 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-65bd8411-3be5-4314-81df-e1431ac6b956 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1244 microversion: 2.1 time: 0.122107 May 19 13:56:38.225742 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 177/360] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:38 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1244 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:39.242681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4f8f6ea8-2da6-4e88-b470-bff609eb72d8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:39.244107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4f8f6ea8-2da6-4e88-b470-bff609eb72d8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:39.253139 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4f8f6ea8-2da6-4e88-b470-bff609eb72d8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:39.255252 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4f8f6ea8-2da6-4e88-b470-bff609eb72d8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:39.256446 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4f8f6ea8-2da6-4e88-b470-bff609eb72d8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:39.257255 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4f8f6ea8-2da6-4e88-b470-bff609eb72d8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:39.464642 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4f8f6ea8-2da6-4e88-b470-bff609eb72d8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:39.491056 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4f8f6ea8-2da6-4e88-b470-bff609eb72d8 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1240 microversion: 2.1 time: 0.251925 May 19 13:56:39.499958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 184/361] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:39 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1240 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:39.761554 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0cc4b9ff-1006-46a6-a445-993bb0f210af tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:39.762239 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0cc4b9ff-1006-46a6-a445-993bb0f210af tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:39.769650 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cc4b9ff-1006-46a6-a445-993bb0f210af tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:39.770547 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cc4b9ff-1006-46a6-a445-993bb0f210af tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:39.772606 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cc4b9ff-1006-46a6-a445-993bb0f210af tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:39.773936 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cc4b9ff-1006-46a6-a445-993bb0f210af tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:39.805324 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0cc4b9ff-1006-46a6-a445-993bb0f210af tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/ips" status: 200 len: 150 microversion: 2.1 time: 0.047509 May 19 13:56:39.806672 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 178/362] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 13:56:39 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:56:40.514213 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fa825a5b-d150-424f-88e2-ed3d2d09252e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:40.514985 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-fa825a5b-d150-424f-88e2-ed3d2d09252e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:40.536900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fa825a5b-d150-424f-88e2-ed3d2d09252e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:40.538522 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fa825a5b-d150-424f-88e2-ed3d2d09252e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:40.540338 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fa825a5b-d150-424f-88e2-ed3d2d09252e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:40.543373 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fa825a5b-d150-424f-88e2-ed3d2d09252e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:40.856718 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fa825a5b-d150-424f-88e2-ed3d2d09252e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:40.870559 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-fa825a5b-d150-424f-88e2-ed3d2d09252e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1314 microversion: 2.1 time: 0.357749 May 19 13:56:40.872100 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 185/363] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:40 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:41.557027 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b52475f3-8f8a-4669-b8be-1be4aebe889e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:41.560164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b52475f3-8f8a-4669-b8be-1be4aebe889e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:41.569778 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b52475f3-8f8a-4669-b8be-1be4aebe889e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:41.570603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b52475f3-8f8a-4669-b8be-1be4aebe889e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:41.571904 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b52475f3-8f8a-4669-b8be-1be4aebe889e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:41.572564 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b52475f3-8f8a-4669-b8be-1be4aebe889e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:41.630495 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=66 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:41.672271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-b52475f3-8f8a-4669-b8be-1be4aebe889e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lazy-loading 'flavor' on Instance uuid 5c4e2c2f-4753-4911-8859-73736543f959 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:56:41.851604 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-819826c4-f2cf-4aa4-a440-658c46367d14 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aebd848d-ae1f-4b07-b001-1c7d757b3491"}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:41.868081 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-819826c4-f2cf-4aa4-a440-658c46367d14 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:41.893574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-819826c4-f2cf-4aa4-a440-658c46367d14 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:41.898972 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-819826c4-f2cf-4aa4-a440-658c46367d14 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:41.899851 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-819826c4-f2cf-4aa4-a440-658c46367d14 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:41.900302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-819826c4-f2cf-4aa4-a440-658c46367d14 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:42.506248 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b52475f3-8f8a-4669-b8be-1be4aebe889e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/action" status: 202 len: 0 microversion: 2.20 time: 0.941065 May 19 13:56:42.508190 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 179/364] 10.222.0.52 () {62 vars in 1318 bytes} [Thu May 19 13:56:41 2022] POST /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/action => generated 0 bytes in 958 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 13:56:42.553425 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4dd7b287-01cf-487f-aa51-70915748407b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:42.554609 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4dd7b287-01cf-487f-aa51-70915748407b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:42.590396 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4dd7b287-01cf-487f-aa51-70915748407b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:42.591172 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4dd7b287-01cf-487f-aa51-70915748407b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:42.591659 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4dd7b287-01cf-487f-aa51-70915748407b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:42.592098 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4dd7b287-01cf-487f-aa51-70915748407b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:42.768323 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-819826c4-f2cf-4aa4-a440-658c46367d14 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.903341 May 19 13:56:42.772421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 186/365] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 13:56:41 2022] POST /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:56:42.793550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:42.795604 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:42.821110 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:42.822696 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:42.825906 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:42.837535 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:43.468584 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:43.496218 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:43.508123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:43.509629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-fdcecabc-d66d-42e2-873f-b1af930f6924 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.733812 May 19 13:56:43.517375 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 187/366] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:42 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:56:43.894073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4dd7b287-01cf-487f-aa51-70915748407b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:43.908107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4dd7b287-01cf-487f-aa51-70915748407b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 1.397544 May 19 13:56:43.922067 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 180/367] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:42 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:44.538662 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:44.540081 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:44.557787 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:44.559096 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:44.571159 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:44.572151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:44.938088 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b6718855-e76e-442f-9eaa-52709264c155 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:44.939331 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b6718855-e76e-442f-9eaa-52709264c155 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:44.993885 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b6718855-e76e-442f-9eaa-52709264c155 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:44.994543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b6718855-e76e-442f-9eaa-52709264c155 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:45.000254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b6718855-e76e-442f-9eaa-52709264c155 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:45.003053 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b6718855-e76e-442f-9eaa-52709264c155 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:45.220756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:45.223701 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:45.231917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:45.233766 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:45.235291 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-955eac61-f358-4c3a-819e-3c74d75a81fa tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.701824 May 19 13:56:45.248740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 188/368] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:44 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:56:45.408464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b6718855-e76e-442f-9eaa-52709264c155 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:45.418481 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b6718855-e76e-442f-9eaa-52709264c155 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 0.492644 May 19 13:56:45.429324 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 181/369] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:44 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:45.514475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-f60e7e57-9489-4982-8336-8d1d6e6a1884 req-91908ccc-935d-4958-96bc-5842d7025437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83247503-3bc5-4f4d-9221-acd8b14033e8", "tag": "9636a338-81c2-4e01-8620-ce36ba238295"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:45.534342 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-f60e7e57-9489-4982-8336-8d1d6e6a1884 req-91908ccc-935d-4958-96bc-5842d7025437 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:45.539024 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-f60e7e57-9489-4982-8336-8d1d6e6a1884 req-91908ccc-935d-4958-96bc-5842d7025437 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:45.556151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-f60e7e57-9489-4982-8336-8d1d6e6a1884 req-91908ccc-935d-4958-96bc-5842d7025437 service nova] Creating event network-changed:9636a338-81c2-4e01-8620-ce36ba238295 for instance 83247503-3bc5-4f4d-9221-acd8b14033e8 on hv-cinder-78481 May 19 13:56:45.565291 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-f60e7e57-9489-4982-8336-8d1d6e6a1884 req-91908ccc-935d-4958-96bc-5842d7025437 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055962 May 19 13:56:45.566131 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 189/370] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:56:46.260553 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:46.261907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:46.279994 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:46.286605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:46.289223 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:46.293373 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:46.437783 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3f982aa2-0d78-4b45-9d40-d7ba8cb1a16e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:46.438936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3f982aa2-0d78-4b45-9d40-d7ba8cb1a16e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:46.455904 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3f982aa2-0d78-4b45-9d40-d7ba8cb1a16e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:46.462141 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3f982aa2-0d78-4b45-9d40-d7ba8cb1a16e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:46.464342 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3f982aa2-0d78-4b45-9d40-d7ba8cb1a16e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:46.464951 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3f982aa2-0d78-4b45-9d40-d7ba8cb1a16e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:46.729465 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:46.773906 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:46.780159 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:46.783439 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9a7b0365-e6e6-461e-b7e5-d454d2fbca04 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.529243 May 19 13:56:46.785908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 182/371] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:46 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:56:46.847563 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3f982aa2-0d78-4b45-9d40-d7ba8cb1a16e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:46.863753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3f982aa2-0d78-4b45-9d40-d7ba8cb1a16e tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 0.427707 May 19 13:56:46.864614 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 190/372] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:46 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:47.802519 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:47.804396 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:47.821030 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:47.823089 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:47.824013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:47.824947 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:47.881480 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bc7de2f4-9a3c-4d0e-b659-341a575e1df5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:47.883685 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bc7de2f4-9a3c-4d0e-b659-341a575e1df5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:47.896121 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bc7de2f4-9a3c-4d0e-b659-341a575e1df5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:47.896798 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bc7de2f4-9a3c-4d0e-b659-341a575e1df5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:47.897879 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bc7de2f4-9a3c-4d0e-b659-341a575e1df5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:47.898431 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bc7de2f4-9a3c-4d0e-b659-341a575e1df5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:47.936058 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:47.967611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=6 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:48.216924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=6 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:48.318967 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:48.337399 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:48.339767 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:48.341454 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6182ba31-c954-4a4a-b523-fb5d04c3a431 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.543534 May 19 13:56:48.343194 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 183/373] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:47 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:56:48.356474 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bc7de2f4-9a3c-4d0e-b659-341a575e1df5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:48.365569 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bc7de2f4-9a3c-4d0e-b659-341a575e1df5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 0.488366 May 19 13:56:48.366495 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 191/374] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:47 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:56:49.362678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:49.363449 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:49.370549 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:49.371500 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:49.372659 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:49.373394 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:49.388643 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f2e89f6c-4d9b-433f-8005-199b4ada84e3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:49.389393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f2e89f6c-4d9b-433f-8005-199b4ada84e3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:49.398366 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2e89f6c-4d9b-433f-8005-199b4ada84e3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:49.398928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2e89f6c-4d9b-433f-8005-199b4ada84e3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:49.401285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2e89f6c-4d9b-433f-8005-199b4ada84e3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:49.401728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2e89f6c-4d9b-433f-8005-199b4ada84e3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:49.850776 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:49.863163 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:49.869576 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:49.881320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-92f9ef94-5d57-4dae-a89a-f057a0509f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.524073 May 19 13:56:49.883166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f2e89f6c-4d9b-433f-8005-199b4ada84e3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:49.894548 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 184/375] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:49 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:56:49.902924 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f2e89f6c-4d9b-433f-8005-199b4ada84e3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 0.518668 May 19 13:56:49.904059 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 192/376] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:49 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:50.902627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:50.903689 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:50.912285 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:50.913107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:50.914122 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:50.916366 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:50.920131 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a8d13d3a-4a9b-4347-bb58-5038610288f4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:50.920849 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a8d13d3a-4a9b-4347-bb58-5038610288f4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:50.944428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a8d13d3a-4a9b-4347-bb58-5038610288f4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:50.946445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a8d13d3a-4a9b-4347-bb58-5038610288f4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:50.947472 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a8d13d3a-4a9b-4347-bb58-5038610288f4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:50.948074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a8d13d3a-4a9b-4347-bb58-5038610288f4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:51.411953 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:51.424559 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:51.426133 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:51.427368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-64f88fec-31f3-4e27-bcac-a9dc3b461aae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.529169 May 19 13:56:51.427943 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 185/377] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:50 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:56:51.431703 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a8d13d3a-4a9b-4347-bb58-5038610288f4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:51.446426 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a8d13d3a-4a9b-4347-bb58-5038610288f4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 0.530352 May 19 13:56:51.472244 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 193/378] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:50 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:52.447263 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:52.447928 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:52.458842 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:52.466094 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-33220e0f-c827-462e-9f0b-d592f2edf569 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:52.467643 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-33220e0f-c827-462e-9f0b-d592f2edf569 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:52.468105 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:52.468969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:52.469665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:52.480721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33220e0f-c827-462e-9f0b-d592f2edf569 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:52.481913 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33220e0f-c827-462e-9f0b-d592f2edf569 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:52.488251 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33220e0f-c827-462e-9f0b-d592f2edf569 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:52.489413 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-33220e0f-c827-462e-9f0b-d592f2edf569 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:52.926239 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-33220e0f-c827-462e-9f0b-d592f2edf569 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:52.934756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-33220e0f-c827-462e-9f0b-d592f2edf569 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 0.472385 May 19 13:56:52.940055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 194/379] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:52 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:52.949612 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:52.965642 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:52.967225 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:52.968755 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c995a288-8897-4ea9-8096-a02bf9a9a10d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.527063 May 19 13:56:52.985878 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 186/380] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:52 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:56:53.961273 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a0a915a9-a5d7-45f3-9b8a-fb40c85254da tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:53.962844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a0a915a9-a5d7-45f3-9b8a-fb40c85254da tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:53.982393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a0a915a9-a5d7-45f3-9b8a-fb40c85254da tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:53.987536 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a0a915a9-a5d7-45f3-9b8a-fb40c85254da tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:53.988051 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:53.988667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:53.989521 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a0a915a9-a5d7-45f3-9b8a-fb40c85254da tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:53.990154 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a0a915a9-a5d7-45f3-9b8a-fb40c85254da tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:54.009026 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:54.009527 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:54.013124 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:54.013586 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:54.598804 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:54.615778 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a0a915a9-a5d7-45f3-9b8a-fb40c85254da tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:54.622663 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:54.623819 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a0a915a9-a5d7-45f3-9b8a-fb40c85254da tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 0.671469 May 19 13:56:54.624388 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 195/381] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:53 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:54.626712 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:54.628681 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-882be91f-79d1-4a19-96e3-b0ce03d47c22 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.645461 May 19 13:56:54.641810 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 187/382] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:53 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:56:55.648662 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-95b03642-79a0-42ca-99eb-beb6f29211ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:55.650947 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:55.652221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:55.653085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-95b03642-79a0-42ca-99eb-beb6f29211ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:55.675112 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-95b03642-79a0-42ca-99eb-beb6f29211ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:55.675566 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-95b03642-79a0-42ca-99eb-beb6f29211ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:55.675566 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-95b03642-79a0-42ca-99eb-beb6f29211ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:55.685820 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:55.688384 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:55.691412 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:55.693937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-95b03642-79a0-42ca-99eb-beb6f29211ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:55.702440 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:56.645810 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:56.657489 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:56.661858 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:56.664107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-53b828fe-5d09-4e20-9ca8-0c1f1ac5a234 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 1.019884 May 19 13:56:56.665342 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 188/383] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:55 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:56:56.681473 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-95b03642-79a0-42ca-99eb-beb6f29211ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:56.694936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-95b03642-79a0-42ca-99eb-beb6f29211ed tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 1.056947 May 19 13:56:56.695932 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 196/384] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:55 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:56.698388 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0c41c2d9-01d7-4bb9-a061-17f0df722745 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: .version_select at 0x7f5de1f5a700>, body: {"keypair": {"name": "tempest-keypair-2023164970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP28dRH6lRG7Uua56ik3YqFoNgQmM0eFzYLzY3GQh+iJSU0mfS8bJeoQ+gKRN40OMy7CTZONXNI5Cvxsgj2sJVcNKmFLnDrGcMmVmO22l2MuN/vDJLNLoEb55QBUCAkH6A=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:56.701454 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-fe5aa82c-f71e-4129-9e3f-4cf3b6018376 req-64cbeb63-e005-4dc9-85c0-e4af5543a193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83247503-3bc5-4f4d-9221-acd8b14033e8", "name": "network-vif-plugged", "status": "completed", "tag": "9636a338-81c2-4e01-8620-ce36ba238295"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:56.738761 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-fe5aa82c-f71e-4129-9e3f-4cf3b6018376 req-64cbeb63-e005-4dc9-85c0-e4af5543a193 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:56.739260 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-fe5aa82c-f71e-4129-9e3f-4cf3b6018376 req-64cbeb63-e005-4dc9-85c0-e4af5543a193 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:56.768176 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-0c41c2d9-01d7-4bb9-a061-17f0df722745 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for project 89b4336043d5446b922432a2f43af17a. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:56:56.783800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-0c41c2d9-01d7-4bb9-a061-17f0df722745 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for user 0cc3e0105f2a472092423852b1f39979 and project 89b4336043d5446b922432a2f43af17a. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:56:56.796809 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-fe5aa82c-f71e-4129-9e3f-4cf3b6018376 req-64cbeb63-e005-4dc9-85c0-e4af5543a193 service nova] Creating event network-vif-plugged:9636a338-81c2-4e01-8620-ce36ba238295 for instance 83247503-3bc5-4f4d-9221-acd8b14033e8 on hv-cinder-78481 May 19 13:56:56.819166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-fe5aa82c-f71e-4129-9e3f-4cf3b6018376 req-64cbeb63-e005-4dc9-85c0-e4af5543a193 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118319 May 19 13:56:56.821888 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 197/385] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:56:56.849255 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0c41c2d9-01d7-4bb9-a061-17f0df722745 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182177 May 19 13:56:56.849996 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 189/386] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 13:56:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:56:57.686981 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:57.688213 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:57.702636 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:57.705286 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:57.708377 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:57.710119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:57.713910 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2520bad9-6eb5-4c4c-b7f7-82f2a32043b0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:57.714645 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2520bad9-6eb5-4c4c-b7f7-82f2a32043b0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:57.717652 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:56:57.723849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2520bad9-6eb5-4c4c-b7f7-82f2a32043b0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:57.741942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2520bad9-6eb5-4c4c-b7f7-82f2a32043b0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:57.743000 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2520bad9-6eb5-4c4c-b7f7-82f2a32043b0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:57.743525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2520bad9-6eb5-4c4c-b7f7-82f2a32043b0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:58.042746 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:58.061002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:58.067056 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:58.073367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ba413489-f506-441c-9011-6d09f55df96d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.390823 May 19 13:56:58.075425 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 198/387] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:57 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:56:58.128791 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2520bad9-6eb5-4c4c-b7f7-82f2a32043b0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:58.140663 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2520bad9-6eb5-4c4c-b7f7-82f2a32043b0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 0.431101 May 19 13:56:58.141805 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 190/388] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:57 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:56:59.103959 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:59.106119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:59.116310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:59.116981 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:59.119161 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:59.120976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:59.160987 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-09760483-9d7c-4b5e-a455-750eb63ccd0c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:56:59.162212 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-09760483-9d7c-4b5e-a455-750eb63ccd0c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:56:59.174381 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-09760483-9d7c-4b5e-a455-750eb63ccd0c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:59.175168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-09760483-9d7c-4b5e-a455-750eb63ccd0c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:59.177650 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-09760483-9d7c-4b5e-a455-750eb63ccd0c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:56:59.178090 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-09760483-9d7c-4b5e-a455-750eb63ccd0c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:56:59.583964 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:59.601899 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:59.603428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:59.605135 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-70ed5038-1d90-4147-8a16-c45e0f326ba1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.508262 May 19 13:56:59.606834 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 199/389] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:56:59 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:56:59.714261 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1551253183", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08206db8-8e78-4412-8a62-0db97bb617cf"}], "security_groups": [{"name": "tempest-securitygroup--93507787"}], "key_name": "tempest-keypair-2023164970", "user_data": "}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:56:59.751886 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-09760483-9d7c-4b5e-a455-750eb63ccd0c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:56:59.764155 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-09760483-9d7c-4b5e-a455-750eb63ccd0c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1369 microversion: 2.1 time: 0.607859 May 19 13:56:59.765136 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 191/390] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:56:59 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1369 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:00.629869 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:00.632942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:00.645059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:00.645570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:00.648505 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:00.649870 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:00.885925 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:00.903204 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:00.906108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:00.909748 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-674283f7-6ee4-494c-b7ba-df541a60d68c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.286530 May 19 13:57:00.920311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 192/391] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:00 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:00.920311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e3d2b51b-5cf6-484c-a764-b9177a03619b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:00.920311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e3d2b51b-5cf6-484c-a764-b9177a03619b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:00.936800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3d2b51b-5cf6-484c-a764-b9177a03619b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:00.937253 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3d2b51b-5cf6-484c-a764-b9177a03619b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:00.938413 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3d2b51b-5cf6-484c-a764-b9177a03619b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:00.938845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3d2b51b-5cf6-484c-a764-b9177a03619b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:01.138457 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] validate_networks() for [('08206db8-8e78-4412-8a62-0db97bb617cf', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:57:01.535293 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e3d2b51b-5cf6-484c-a764-b9177a03619b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:01.546203 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e3d2b51b-5cf6-484c-a764-b9177a03619b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1562 microversion: 2.1 time: 0.634302 May 19 13:57:01.548794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 193/392] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:00 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1562 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:01.570834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f6307313-6862-4f4c-a85d-b9eeae030987 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:01.571837 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f6307313-6862-4f4c-a85d-b9eeae030987 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:01.581683 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6307313-6862-4f4c-a85d-b9eeae030987 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:01.583244 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6307313-6862-4f4c-a85d-b9eeae030987 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:01.584266 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6307313-6862-4f4c-a85d-b9eeae030987 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:01.586119 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6307313-6862-4f4c-a85d-b9eeae030987 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:01.842430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f6307313-6862-4f4c-a85d-b9eeae030987 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.281260 May 19 13:57:01.843612 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 194/393] 10.222.0.52 () {58 vars in 1274 bytes} [Thu May 19 13:57:01 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-interface => generated 284 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:57:01.854623 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:01.928927 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:01.929942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:01.942351 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:01.946826 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:01.947867 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:01.948459 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:01.954161 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:02.381980 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:02.394997 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:02.396966 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:02.407255 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-704f612b-d7e6-4935-8a89-9b7981307837 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.475659 May 19 13:57:02.408425 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 195/394] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:01 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:02.617417 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:57:02.618044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:57:02.618631 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:57:02.619679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:57:02.620361 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:57:02.653561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:02.654108 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:02.655047 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:02.655721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:02.700312 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for project 89b4336043d5446b922432a2f43af17a. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:57:02.709443 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for user 0cc3e0105f2a472092423852b1f39979 and project 89b4336043d5446b922432a2f43af17a. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:57:02.753280 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:57:02.760006 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:57:02.920457 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d46e0039-c7e5-4fee-83e5-fff790797922 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.210658 May 19 13:57:02.928766 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 200/395] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:56:59 2022] POST /compute/v2.1/servers => generated 400 bytes in 3220 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:57:02.934474 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6ba47f00-196e-431e-ab07-26f541628f03 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:02.939231 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6ba47f00-196e-431e-ab07-26f541628f03 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:03.188747 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6ba47f00-196e-431e-ab07-26f541628f03 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:03.201678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6ba47f00-196e-431e-ab07-26f541628f03 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1242 microversion: 2.1 time: 0.273292 May 19 13:57:03.206513 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 196/396] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:02 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1242 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:03.427021 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:03.427730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:03.460574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:03.460574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:03.466090 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:03.466550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:03.775652 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:03.790414 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:03.794751 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:03.802246 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ac3af43a-9c80-4246-a136-ec5e55b9c153 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1743 microversion: 2.20 time: 0.377472 May 19 13:57:03.803601 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 201/397] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:03 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1743 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:04.226762 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-11489cc9-d8a1-4814-8694-6b09e44a0a82 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:04.228415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-11489cc9-d8a1-4814-8694-6b09e44a0a82 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:04.265084 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11489cc9-d8a1-4814-8694-6b09e44a0a82 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:04.270686 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11489cc9-d8a1-4814-8694-6b09e44a0a82 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:04.274825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11489cc9-d8a1-4814-8694-6b09e44a0a82 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:04.275564 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11489cc9-d8a1-4814-8694-6b09e44a0a82 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:04.591635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-11489cc9-d8a1-4814-8694-6b09e44a0a82 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:04.611861 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-11489cc9-d8a1-4814-8694-6b09e44a0a82 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1238 microversion: 2.1 time: 0.389313 May 19 13:57:04.612426 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 197/398] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:04 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1238 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:04.822432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:04.823246 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:04.836253 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-070e49f0-823d-4897-a153-833de49cc60e req-479df919-b083-42ad-a945-aa0198179fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83247503-3bc5-4f4d-9221-acd8b14033e8", "tag": "9636a338-81c2-4e01-8620-ce36ba238295"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:04.844533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:04.844990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:04.845777 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:04.846311 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:04.850956 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-070e49f0-823d-4897-a153-833de49cc60e req-479df919-b083-42ad-a945-aa0198179fe1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:04.851436 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-070e49f0-823d-4897-a153-833de49cc60e req-479df919-b083-42ad-a945-aa0198179fe1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:04.895564 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-070e49f0-823d-4897-a153-833de49cc60e req-479df919-b083-42ad-a945-aa0198179fe1 service nova] Creating event network-changed:9636a338-81c2-4e01-8620-ce36ba238295 for instance 83247503-3bc5-4f4d-9221-acd8b14033e8 on hv-cinder-78481 May 19 13:57:04.911220 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-070e49f0-823d-4897-a153-833de49cc60e req-479df919-b083-42ad-a945-aa0198179fe1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080579 May 19 13:57:04.915628 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 198/399] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:57:05.630579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-35af2fc8-005a-42de-8b1d-8b330437052a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:05.632017 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-35af2fc8-005a-42de-8b1d-8b330437052a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:05.655111 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35af2fc8-005a-42de-8b1d-8b330437052a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:05.655562 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35af2fc8-005a-42de-8b1d-8b330437052a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:05.658994 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35af2fc8-005a-42de-8b1d-8b330437052a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:05.661771 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35af2fc8-005a-42de-8b1d-8b330437052a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:06.149162 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-35af2fc8-005a-42de-8b1d-8b330437052a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:06.159383 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-35af2fc8-005a-42de-8b1d-8b330437052a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1300 microversion: 2.1 time: 0.533938 May 19 13:57:06.165269 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 199/400] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:05 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1300 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:06.198566 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:06.235710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:06.239200 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:06.245857 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bd85a3da-196b-4375-8f98-5093f097d914 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1743 microversion: 2.20 time: 1.428179 May 19 13:57:06.250092 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 202/401] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:04 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1743 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:07.192837 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b7159a8d-9505-4ed1-ba8c-7673c27948d2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:07.196728 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b7159a8d-9505-4ed1-ba8c-7673c27948d2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:07.225294 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7159a8d-9505-4ed1-ba8c-7673c27948d2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:07.236148 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7159a8d-9505-4ed1-ba8c-7673c27948d2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:07.244444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7159a8d-9505-4ed1-ba8c-7673c27948d2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:07.246063 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7159a8d-9505-4ed1-ba8c-7673c27948d2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:07.268518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:07.270105 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:07.301303 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:07.303827 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:07.307520 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:07.308528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:07.670074 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b7159a8d-9505-4ed1-ba8c-7673c27948d2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:07.682614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b7159a8d-9505-4ed1-ba8c-7673c27948d2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1300 microversion: 2.1 time: 0.499992 May 19 13:57:07.686141 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 200/402] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:07 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1300 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:08.148248 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:08.171639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:08.176751 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:08.186774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-51a8a764-484a-4317-9ca9-9ac97ba8a0b4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.922039 May 19 13:57:08.192155 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 203/403] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:07 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:08.702071 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-63cdd221-002e-4bf6-addb-903974c72429 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:08.702736 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-63cdd221-002e-4bf6-addb-903974c72429 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:08.720985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-63cdd221-002e-4bf6-addb-903974c72429 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:08.721409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-63cdd221-002e-4bf6-addb-903974c72429 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:08.722190 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-63cdd221-002e-4bf6-addb-903974c72429 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:08.735916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-63cdd221-002e-4bf6-addb-903974c72429 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:09.210284 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:09.210921 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:09.232137 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:09.232590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:09.233372 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:09.233819 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:09.377135 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-63cdd221-002e-4bf6-addb-903974c72429 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:09.403132 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-63cdd221-002e-4bf6-addb-903974c72429 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 0.703265 May 19 13:57:09.403791 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 201/404] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:08 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:09.771707 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:09.788712 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-d9fb2adf-97c1-42e5-ae6c-f1017dd7f0fa req-603435fe-e7a2-46bf-8ee3-5afd3bdc6535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e2c2f-4753-4911-8859-73736543f959", "name": "network-vif-plugged", "status": "completed", "tag": "5e326997-1358-457a-8426-4184a94bfdad"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:09.790564 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:09.798004 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:09.800179 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c582e2d9-37b2-486d-885c-b41248c56bdd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.594843 May 19 13:57:09.801259 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 204/405] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:09 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:09.845764 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-d9fb2adf-97c1-42e5-ae6c-f1017dd7f0fa req-603435fe-e7a2-46bf-8ee3-5afd3bdc6535 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:09.846209 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-d9fb2adf-97c1-42e5-ae6c-f1017dd7f0fa req-603435fe-e7a2-46bf-8ee3-5afd3bdc6535 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:09.900139 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-d9fb2adf-97c1-42e5-ae6c-f1017dd7f0fa req-603435fe-e7a2-46bf-8ee3-5afd3bdc6535 service nova] Creating event network-vif-plugged:5e326997-1358-457a-8426-4184a94bfdad for instance 5c4e2c2f-4753-4911-8859-73736543f959 on hv-cinder-78481 May 19 13:57:09.929323 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-d9fb2adf-97c1-42e5-ae6c-f1017dd7f0fa req-603435fe-e7a2-46bf-8ee3-5afd3bdc6535 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147334 May 19 13:57:09.933045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 202/406] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:10.004504 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4ec3c9a1-08f0-4f6f-8778-e04a4f6b81af tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Action: 'create', calling method: .version_select at 0x7f5de2dcaca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1267529478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE319v1csig7yY/UTYgs4bfnXL0nj/46gEN1bVXQoyctRCM/ayx/oxu1RYnQBCaiFzJGDfrvPEmQmZrpZ8AZyqpRXBQUjp52QoB+qs2azoSJ0priLYufjswIUFbdu1Dk2A=="}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:10.078726 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-4ec3c9a1-08f0-4f6f-8778-e04a4f6b81af tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Getting quotas for project a51cbae6cb494a2fac656e416fe868c2. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:57:10.097557 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-4ec3c9a1-08f0-4f6f-8778-e04a4f6b81af tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Getting quotas for user a1274435c6774faa9eeeac6726b52b47 and project a51cbae6cb494a2fac656e416fe868c2. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:57:10.209256 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4ec3c9a1-08f0-4f6f-8778-e04a4f6b81af tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.213890 May 19 13:57:10.210566 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 205/407] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 13:57:09 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:10.429833 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-52d2633e-3613-4245-9c6a-b273c5fdc56e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:10.430687 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-52d2633e-3613-4245-9c6a-b273c5fdc56e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:10.456302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52d2633e-3613-4245-9c6a-b273c5fdc56e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:10.459509 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52d2633e-3613-4245-9c6a-b273c5fdc56e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:10.464918 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52d2633e-3613-4245-9c6a-b273c5fdc56e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:10.465408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52d2633e-3613-4245-9c6a-b273c5fdc56e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:10.552606 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-172327837", "imageRef": "3bd3dde6-556b-4208-bbe9-cff7d0b5da63", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1267529478", "networks": [{"uuid": "15bb1d4f-0ff2-4028-9d32-0d8c1a69a8f8"}]}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:10.658481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] validate_networks() for [('15bb1d4f-0ff2-4028-9d32-0d8c1a69a8f8', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:57:11.790188 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-52d2633e-3613-4245-9c6a-b273c5fdc56e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:11.810229 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-52d2633e-3613-4245-9c6a-b273c5fdc56e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 1.381380 May 19 13:57:11.810945 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 203/408] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:10 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:11.859589 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:11.861420 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:11.929549 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:11.931540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:11.933593 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:11.934845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:12.512205 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:12.529562 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:12.531227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:12.532717 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8a952881-9f5b-4233-b1a3-97fdf3b386c1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.704326 May 19 13:57:12.533278 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 204/409] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:11 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:12.678637 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:12.688665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-9dae9692-100b-4807-af30-4f0ab35e9395 req-8fcb589a-1573-4592-b67b-97babf44e337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4", "tag": "c02446b0-9eb0-4b0a-a1be-d0bf663a7a3d"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:12.705371 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9dae9692-100b-4807-af30-4f0ab35e9395 req-8fcb589a-1573-4592-b67b-97babf44e337 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:12.706215 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9dae9692-100b-4807-af30-4f0ab35e9395 req-8fcb589a-1573-4592-b67b-97babf44e337 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:12.746817 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-9dae9692-100b-4807-af30-4f0ab35e9395 req-8fcb589a-1573-4592-b67b-97babf44e337 service nova] Creating event network-changed:c02446b0-9eb0-4b0a-a1be-d0bf663a7a3d for instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 on hv-cinder-78481 May 19 13:57:12.749529 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:57:12.751294 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:57:12.751941 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:57:12.752352 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:57:12.752760 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:57:12.758688 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-9dae9692-100b-4807-af30-4f0ab35e9395 req-8fcb589a-1573-4592-b67b-97babf44e337 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074652 May 19 13:57:12.759354 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 205/410] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:57:12.784065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:12.784518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:12.785312 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:12.785746 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:12.828849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-91778127-60fe-4d7a-8936-f9f55d113940 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:12.830055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-91778127-60fe-4d7a-8936-f9f55d113940 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:12.841824 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91778127-60fe-4d7a-8936-f9f55d113940 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:12.843121 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91778127-60fe-4d7a-8936-f9f55d113940 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:12.848537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91778127-60fe-4d7a-8936-f9f55d113940 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:12.848994 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91778127-60fe-4d7a-8936-f9f55d113940 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:12.858474 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Getting quotas for project a51cbae6cb494a2fac656e416fe868c2. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:57:12.872205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Getting quotas for user a1274435c6774faa9eeeac6726b52b47 and project a51cbae6cb494a2fac656e416fe868c2. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:57:12.927870 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:57:12.930660 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3bd3dde6-556b-4208-bbe9-cff7d0b5da63',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:57:13.035281 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4da60e2f-3e08-4bbc-a82e-9111d74a3a41 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.488599 May 19 13:57:13.042595 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 206/411] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:57:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 13:57:13.048975 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c75ca6cd-f2df-45bd-98ec-5d72e4b3f89a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:13.049837 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c75ca6cd-f2df-45bd-98ec-5d72e4b3f89a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:13.196449 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=6 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:13.263698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c75ca6cd-f2df-45bd-98ec-5d72e4b3f89a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:13.273150 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c75ca6cd-f2df-45bd-98ec-5d72e4b3f89a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1258 microversion: 2.1 time: 0.228840 May 19 13:57:13.293110 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 207/412] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:13 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1258 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:13.363831 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-91778127-60fe-4d7a-8936-f9f55d113940 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:13.377204 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-91778127-60fe-4d7a-8936-f9f55d113940 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 0.553394 May 19 13:57:13.378002 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 206/413] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:12 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:13.559591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:13.560481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:13.572098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:13.572870 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:13.573912 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:13.575734 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:13.844361 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:13.853916 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:13.863001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:13.864527 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5a8583b2-93ec-47bd-b6c2-8c3dd1810b71 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.314228 May 19 13:57:13.866239 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 208/414] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:13 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:14.314378 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-561ea09e-ae2d-49d4-9c3a-bb4754b94730 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:14.315144 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-561ea09e-ae2d-49d4-9c3a-bb4754b94730 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:14.336010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-561ea09e-ae2d-49d4-9c3a-bb4754b94730 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:14.336434 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-561ea09e-ae2d-49d4-9c3a-bb4754b94730 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:14.337518 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-561ea09e-ae2d-49d4-9c3a-bb4754b94730 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:14.338012 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-561ea09e-ae2d-49d4-9c3a-bb4754b94730 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:14.397438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7fd494c9-ee46-4ba7-af49-4a508383f4e3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:14.399014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7fd494c9-ee46-4ba7-af49-4a508383f4e3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:14.417514 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7fd494c9-ee46-4ba7-af49-4a508383f4e3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:14.423732 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7fd494c9-ee46-4ba7-af49-4a508383f4e3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:14.424606 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7fd494c9-ee46-4ba7-af49-4a508383f4e3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:14.426670 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7fd494c9-ee46-4ba7-af49-4a508383f4e3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:14.556417 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-561ea09e-ae2d-49d4-9c3a-bb4754b94730 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:14.567864 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-561ea09e-ae2d-49d4-9c3a-bb4754b94730 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1262 microversion: 2.1 time: 0.257914 May 19 13:57:14.582547 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 207/415] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:14 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1262 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:14.885080 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:14.889973 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:14.901589 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7fd494c9-ee46-4ba7-af49-4a508383f4e3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:14.907836 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:14.908325 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:14.909123 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:14.909562 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:14.910676 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7fd494c9-ee46-4ba7-af49-4a508383f4e3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 0.520252 May 19 13:57:14.928920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 209/416] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:14 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:15.105940 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:15.135695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:15.145705 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:15.147028 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7d16d2fe-fc05-4b0a-85c4-387490d0e138 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.266434 May 19 13:57:15.147785 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 208/417] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:14 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:15.589104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-258222f7-817d-42b9-9da5-e389bd1741d9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:15.590740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-258222f7-817d-42b9-9da5-e389bd1741d9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:15.601081 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-258222f7-817d-42b9-9da5-e389bd1741d9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:15.603541 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-258222f7-817d-42b9-9da5-e389bd1741d9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:15.604541 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-258222f7-817d-42b9-9da5-e389bd1741d9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:15.605166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-258222f7-817d-42b9-9da5-e389bd1741d9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:15.634319 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:15.698263 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-258222f7-817d-42b9-9da5-e389bd1741d9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:15.706556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-258222f7-817d-42b9-9da5-e389bd1741d9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1262 microversion: 2.1 time: 0.121186 May 19 13:57:15.709574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 210/418] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:15 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1262 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:15.929265 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-20eedf8d-fd7e-4b58-a08d-e6155b3e2e62 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:15.929995 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-20eedf8d-fd7e-4b58-a08d-e6155b3e2e62 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:15.953510 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-20eedf8d-fd7e-4b58-a08d-e6155b3e2e62 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:15.953866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-20eedf8d-fd7e-4b58-a08d-e6155b3e2e62 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:15.954663 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-20eedf8d-fd7e-4b58-a08d-e6155b3e2e62 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:15.955125 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-20eedf8d-fd7e-4b58-a08d-e6155b3e2e62 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:16.166367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:16.167068 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:16.176837 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:16.180169 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:16.184187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:16.184830 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:16.336559 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-20eedf8d-fd7e-4b58-a08d-e6155b3e2e62 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:16.354571 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-20eedf8d-fd7e-4b58-a08d-e6155b3e2e62 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 0.429333 May 19 13:57:16.359621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 209/419] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:15 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:16.539045 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:16.550353 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:16.551976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:16.554687 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f782be5b-fe6b-45a0-91f7-f21de4bb2058 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.392551 May 19 13:57:16.567308 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 211/420] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:16 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:16.724987 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0dc80954-4e46-4f7b-9b1f-5faf04938a84 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:16.725616 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0dc80954-4e46-4f7b-9b1f-5faf04938a84 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:16.744878 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0dc80954-4e46-4f7b-9b1f-5faf04938a84 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:16.745865 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0dc80954-4e46-4f7b-9b1f-5faf04938a84 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:16.753775 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0dc80954-4e46-4f7b-9b1f-5faf04938a84 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:16.764665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0dc80954-4e46-4f7b-9b1f-5faf04938a84 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:16.961698 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0dc80954-4e46-4f7b-9b1f-5faf04938a84 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:16.972760 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0dc80954-4e46-4f7b-9b1f-5faf04938a84 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1310 microversion: 2.1 time: 0.252791 May 19 13:57:16.977424 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 210/421] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:16 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1310 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:17.378613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-435fb5da-e28a-4312-99c1-2b392e89ff75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:17.380083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-435fb5da-e28a-4312-99c1-2b392e89ff75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:17.412235 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-435fb5da-e28a-4312-99c1-2b392e89ff75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:17.413497 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-435fb5da-e28a-4312-99c1-2b392e89ff75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:17.414849 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-435fb5da-e28a-4312-99c1-2b392e89ff75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:17.416662 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-435fb5da-e28a-4312-99c1-2b392e89ff75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:17.577273 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:17.578805 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:17.592005 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:17.594303 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:17.599860 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:17.600795 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:17.780191 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-435fb5da-e28a-4312-99c1-2b392e89ff75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:17.807573 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-435fb5da-e28a-4312-99c1-2b392e89ff75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 0.434941 May 19 13:57:17.810697 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 212/422] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:17 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:17.873824 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:17.886462 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:17.888767 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:17.890130 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-57b2dc3d-efae-40dc-840c-2f6568483795 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.317745 May 19 13:57:17.891574 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 211/423] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:17 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:17.994083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-42655e8d-9a4e-4b96-9c71-6f087a382932 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:17.994706 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-42655e8d-9a4e-4b96-9c71-6f087a382932 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:18.010382 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-42655e8d-9a4e-4b96-9c71-6f087a382932 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:18.010904 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-42655e8d-9a4e-4b96-9c71-6f087a382932 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:18.011691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-42655e8d-9a4e-4b96-9c71-6f087a382932 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:18.012126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-42655e8d-9a4e-4b96-9c71-6f087a382932 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:18.113060 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-42655e8d-9a4e-4b96-9c71-6f087a382932 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:18.123693 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-42655e8d-9a4e-4b96-9c71-6f087a382932 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1318 microversion: 2.1 time: 0.133568 May 19 13:57:18.124546 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 213/424] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:17 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1318 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:18.829871 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-91eded83-df2d-45a3-a6dc-6e1a12fd7281 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:18.830480 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-91eded83-df2d-45a3-a6dc-6e1a12fd7281 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:18.840918 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91eded83-df2d-45a3-a6dc-6e1a12fd7281 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:18.848976 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91eded83-df2d-45a3-a6dc-6e1a12fd7281 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:18.850001 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91eded83-df2d-45a3-a6dc-6e1a12fd7281 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:18.850461 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91eded83-df2d-45a3-a6dc-6e1a12fd7281 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:18.910290 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:18.910928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:18.935966 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:18.936431 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:18.937998 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:18.942762 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:20.442094 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-91eded83-df2d-45a3-a6dc-6e1a12fd7281 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:20.452576 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:20.469015 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-91eded83-df2d-45a3-a6dc-6e1a12fd7281 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 1.640351 May 19 13:57:20.470424 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 212/425] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:18 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:20.470852 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:20.473186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:20.485451 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5a3b9dd6-9c0d-4104-807a-fe1c5b84e868 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 1.573241 May 19 13:57:20.486743 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 214/426] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:18 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:20.491963 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a7e6c808-1e67-437f-91cd-a9a20795919a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:20.492816 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a7e6c808-1e67-437f-91cd-a9a20795919a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:20.501144 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a7e6c808-1e67-437f-91cd-a9a20795919a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:20.501930 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a7e6c808-1e67-437f-91cd-a9a20795919a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:20.503130 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a7e6c808-1e67-437f-91cd-a9a20795919a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:20.511899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a7e6c808-1e67-437f-91cd-a9a20795919a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:20.649542 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a7e6c808-1e67-437f-91cd-a9a20795919a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:20.686725 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a7e6c808-1e67-437f-91cd-a9a20795919a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1316 microversion: 2.1 time: 0.204270 May 19 13:57:20.691813 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 213/427] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:20 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:21.488737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-511ee9a2-c5ec-4ffa-a048-7d21f7373cdd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:21.490799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-511ee9a2-c5ec-4ffa-a048-7d21f7373cdd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:21.518833 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-511ee9a2-c5ec-4ffa-a048-7d21f7373cdd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:21.523367 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-511ee9a2-c5ec-4ffa-a048-7d21f7373cdd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:21.530045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-511ee9a2-c5ec-4ffa-a048-7d21f7373cdd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:21.536185 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-511ee9a2-c5ec-4ffa-a048-7d21f7373cdd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:21.650441 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-64734555-6a48-4cdd-86d3-5083c8e7d80a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Action: 'create', calling method: .version_select at 0x7f5de2e05040>, body: {"keypair": {"name": "tempest-TestShelveInstance-788156017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzqeaQe8ib1kRTWW7vKxr3xR3CeYcrnTo3o8LNt+iapEEli0p4i26tF4Oy6eCMti51TM5W7y/p5EmwvZUgp67bBZgd3nfxQrRO5+TwqIbmHntxR61X3/JG6H1QIN14YgQ=="}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:21.682360 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-64734555-6a48-4cdd-86d3-5083c8e7d80a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Getting quotas for project 0197b4cff99649ef9da1e77b1461dd76. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:57:21.701193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-64734555-6a48-4cdd-86d3-5083c8e7d80a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Getting quotas for user d5fabcc754684ded96c800be75777553 and project 0197b4cff99649ef9da1e77b1461dd76. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:57:21.771401 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-64734555-6a48-4cdd-86d3-5083c8e7d80a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.668720 May 19 13:57:21.783096 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 215/428] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 13:57:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:21.806997 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:21.807616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:21.855994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:21.856442 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:21.857644 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:21.858079 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:22.151236 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-511ee9a2-c5ec-4ffa-a048-7d21f7373cdd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:22.157650 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=100 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:22.160193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-511ee9a2-c5ec-4ffa-a048-7d21f7373cdd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 0.677379 May 19 13:57:22.160726 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 214/429] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:21 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:22.181319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8b84a8db-7da9-49ef-9e30-14f78f6ebc0b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:22.181943 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8b84a8db-7da9-49ef-9e30-14f78f6ebc0b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:22.205417 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8b84a8db-7da9-49ef-9e30-14f78f6ebc0b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:22.205730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8b84a8db-7da9-49ef-9e30-14f78f6ebc0b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:22.206505 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8b84a8db-7da9-49ef-9e30-14f78f6ebc0b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:22.207147 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8b84a8db-7da9-49ef-9e30-14f78f6ebc0b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:22.489687 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:22.503808 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:22.506571 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:22.510046 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-63fb415f-fd07-4a64-b5c0-7763ae4cebc3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.709049 May 19 13:57:22.512747 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 216/430] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:21 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:22.551240 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8b84a8db-7da9-49ef-9e30-14f78f6ebc0b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:22.561282 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8b84a8db-7da9-49ef-9e30-14f78f6ebc0b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.389775 May 19 13:57:22.563629 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 215/431] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:22 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:23.178241 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2c42b861-9fb5-4c3f-baf3-40b5aaa97acb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:23.180154 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2c42b861-9fb5-4c3f-baf3-40b5aaa97acb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:23.191652 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:23.198021 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c42b861-9fb5-4c3f-baf3-40b5aaa97acb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:23.206685 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c42b861-9fb5-4c3f-baf3-40b5aaa97acb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:23.212504 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c42b861-9fb5-4c3f-baf3-40b5aaa97acb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:23.213552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c42b861-9fb5-4c3f-baf3-40b5aaa97acb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:23.367327 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-b6a3b28f-b830-4c2d-86a5-76482dd3f5cd req-d143eb8f-5f94-4090-806d-3b6ef3076f61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4", "name": "network-vif-plugged", "status": "completed", "tag": "c02446b0-9eb0-4b0a-a1be-d0bf663a7a3d"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:23.382676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-b6a3b28f-b830-4c2d-86a5-76482dd3f5cd req-d143eb8f-5f94-4090-806d-3b6ef3076f61 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:23.384114 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-b6a3b28f-b830-4c2d-86a5-76482dd3f5cd req-d143eb8f-5f94-4090-806d-3b6ef3076f61 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:23.400380 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-b6a3b28f-b830-4c2d-86a5-76482dd3f5cd req-d143eb8f-5f94-4090-806d-3b6ef3076f61 service nova] Creating event network-vif-plugged:c02446b0-9eb0-4b0a-a1be-d0bf663a7a3d for instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 on hv-cinder-78481 May 19 13:57:23.410227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-b6a3b28f-b830-4c2d-86a5-76482dd3f5cd req-d143eb8f-5f94-4090-806d-3b6ef3076f61 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050495 May 19 13:57:23.411563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 216/432] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:23.493262 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-8d9b85ed-67d1-4028-865c-957553e7750d req-2e623499-9819-4e65-a9b8-4a04c5e98cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282f0dfe-fd26-4a02-91e0-69716322d7d5", "tag": "e9f3edc9-7c52-4610-9122-024284dd285b"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:23.534331 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-8d9b85ed-67d1-4028-865c-957553e7750d req-2e623499-9819-4e65-a9b8-4a04c5e98cea service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:23.534794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-8d9b85ed-67d1-4028-865c-957553e7750d req-2e623499-9819-4e65-a9b8-4a04c5e98cea service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:23.574690 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-8d9b85ed-67d1-4028-865c-957553e7750d req-2e623499-9819-4e65-a9b8-4a04c5e98cea service nova] Creating event network-changed:e9f3edc9-7c52-4610-9122-024284dd285b for instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 on hv-cinder-78481 May 19 13:57:23.586585 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-8d9b85ed-67d1-4028-865c-957553e7750d req-2e623499-9819-4e65-a9b8-4a04c5e98cea service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102327 May 19 13:57:23.588643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 217/433] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:23.625200 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:23.631072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:23.647553 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:23.660669 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:23.663549 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:23.667064 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:23.690421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2c42b861-9fb5-4c3f-baf3-40b5aaa97acb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:23.708357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2c42b861-9fb5-4c3f-baf3-40b5aaa97acb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 0.533630 May 19 13:57:23.718053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 217/434] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:23 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:23.741720 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2ead372c-600b-46e0-b0ce-8b85ad685974 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:23.745920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2ead372c-600b-46e0-b0ce-8b85ad685974 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:23.764083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ead372c-600b-46e0-b0ce-8b85ad685974 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:23.764808 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ead372c-600b-46e0-b0ce-8b85ad685974 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:23.767917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ead372c-600b-46e0-b0ce-8b85ad685974 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:23.769133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ead372c-600b-46e0-b0ce-8b85ad685974 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:24.286658 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:24.298546 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:24.300550 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:24.305206 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0faefb37-745c-4543-9c48-cf8ab8c4a3e8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.699136 May 19 13:57:24.306058 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 218/435] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:23 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:24.369587 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2ead372c-600b-46e0-b0ce-8b85ad685974 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:24.379259 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2ead372c-600b-46e0-b0ce-8b85ad685974 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.663999 May 19 13:57:24.388065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 218/436] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:23 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:24.728690 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-01699cb5-828a-47e4-835b-518dd0cf0266 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:24.729316 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-01699cb5-828a-47e4-835b-518dd0cf0266 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:24.745492 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-01699cb5-828a-47e4-835b-518dd0cf0266 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:24.745942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-01699cb5-828a-47e4-835b-518dd0cf0266 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:24.749209 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-01699cb5-828a-47e4-835b-518dd0cf0266 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:24.749743 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-01699cb5-828a-47e4-835b-518dd0cf0266 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:25.066157 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-01699cb5-828a-47e4-835b-518dd0cf0266 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:25.081525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-01699cb5-828a-47e4-835b-518dd0cf0266 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1366 microversion: 2.1 time: 0.357965 May 19 13:57:25.086817 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 219/437] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:24 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:25.324272 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:25.325122 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:25.338597 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:25.339325 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:25.340257 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:25.340840 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:25.409555 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7418ea3e-b136-48a1-923d-698b8393867d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:25.410370 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7418ea3e-b136-48a1-923d-698b8393867d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:25.420008 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7418ea3e-b136-48a1-923d-698b8393867d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:25.420645 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7418ea3e-b136-48a1-923d-698b8393867d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:25.422581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7418ea3e-b136-48a1-923d-698b8393867d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:25.423424 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7418ea3e-b136-48a1-923d-698b8393867d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:25.848176 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7418ea3e-b136-48a1-923d-698b8393867d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:25.859973 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7418ea3e-b136-48a1-923d-698b8393867d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.455655 May 19 13:57:25.874005 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 220/438] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:25 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:25.880721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:25.898800 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:25.905352 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:25.910447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e1d71592-9604-4ba9-a9d2-e9d56d3a74d6 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.589205 May 19 13:57:25.913045 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 219/439] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:25 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:26.108708 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-518fc95c-3944-4998-901f-f013d1c22628 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:26.110706 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-518fc95c-3944-4998-901f-f013d1c22628 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:26.124157 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-518fc95c-3944-4998-901f-f013d1c22628 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:26.126779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-518fc95c-3944-4998-901f-f013d1c22628 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:26.130072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-518fc95c-3944-4998-901f-f013d1c22628 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:26.130915 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-518fc95c-3944-4998-901f-f013d1c22628 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:26.496870 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-518fc95c-3944-4998-901f-f013d1c22628 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:26.507468 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-518fc95c-3944-4998-901f-f013d1c22628 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1556 microversion: 2.1 time: 0.405747 May 19 13:57:26.508976 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 221/440] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:26 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1556 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:26.529118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e5817cd0-8bd0-426c-8708-add9a7a48354 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:26.529898 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e5817cd0-8bd0-426c-8708-add9a7a48354 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:26.548602 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5817cd0-8bd0-426c-8708-add9a7a48354 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:26.549400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5817cd0-8bd0-426c-8708-add9a7a48354 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:26.550358 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5817cd0-8bd0-426c-8708-add9a7a48354 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:26.551045 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5817cd0-8bd0-426c-8708-add9a7a48354 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:26.700561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e5817cd0-8bd0-426c-8708-add9a7a48354 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.175932 May 19 13:57:26.701149 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 220/441] 10.222.0.52 () {58 vars in 1274 bytes} [Thu May 19 13:57:26 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:57:26.877586 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-658e2c9e-f1a2-4e91-87fc-3fad895b1c23 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:26.878194 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-658e2c9e-f1a2-4e91-87fc-3fad895b1c23 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:26.893366 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-658e2c9e-f1a2-4e91-87fc-3fad895b1c23 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:26.893814 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-658e2c9e-f1a2-4e91-87fc-3fad895b1c23 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:26.895789 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-658e2c9e-f1a2-4e91-87fc-3fad895b1c23 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:26.897110 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-658e2c9e-f1a2-4e91-87fc-3fad895b1c23 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:26.931134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:26.931698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:26.944954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:26.945205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:26.945989 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:26.946421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:27.579963 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-658e2c9e-f1a2-4e91-87fc-3fad895b1c23 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:27.598443 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-658e2c9e-f1a2-4e91-87fc-3fad895b1c23 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.720653 May 19 13:57:27.599500 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 222/442] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:26 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:27.657909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:27.672892 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:27.678406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:27.683250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-52e8915f-08a1-4b36-94d4-d3e8792332a1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.756088 May 19 13:57:27.683826 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 221/443] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:26 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:28.618741 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4080a12f-056b-4264-ae69-b7b256c7ba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:28.619408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4080a12f-056b-4264-ae69-b7b256c7ba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:28.622162 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=68 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:28.634609 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4080a12f-056b-4264-ae69-b7b256c7ba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:28.635445 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4080a12f-056b-4264-ae69-b7b256c7ba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:28.636541 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4080a12f-056b-4264-ae69-b7b256c7ba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:28.637181 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4080a12f-056b-4264-ae69-b7b256c7ba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:28.700737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:28.702020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:28.717402 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:28.718145 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:28.719902 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:28.720574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:29.041004 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4080a12f-056b-4264-ae69-b7b256c7ba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:29.050416 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4080a12f-056b-4264-ae69-b7b256c7ba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.435388 May 19 13:57:29.051676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 223/444] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:28 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:29.175854 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-08c3fea9-8cd7-4012-bc46-6b38e5b2e428 req-9c2aae14-be60-40d8-a098-a5884fec32e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4", "tag": "c02446b0-9eb0-4b0a-a1be-d0bf663a7a3d"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:29.187797 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-08c3fea9-8cd7-4012-bc46-6b38e5b2e428 req-9c2aae14-be60-40d8-a098-a5884fec32e2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:29.188370 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-08c3fea9-8cd7-4012-bc46-6b38e5b2e428 req-9c2aae14-be60-40d8-a098-a5884fec32e2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:29.206012 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-08c3fea9-8cd7-4012-bc46-6b38e5b2e428 req-9c2aae14-be60-40d8-a098-a5884fec32e2 service nova] Creating event network-changed:c02446b0-9eb0-4b0a-a1be-d0bf663a7a3d for instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 on hv-cinder-78481 May 19 13:57:29.213985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-08c3fea9-8cd7-4012-bc46-6b38e5b2e428 req-9c2aae14-be60-40d8-a098-a5884fec32e2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043869 May 19 13:57:29.219831 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 224/445] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:29.503650 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:29.517025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:29.521902 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:29.539513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-fc6cb93c-1169-433e-b79a-6a6b4c18c517 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.826267 May 19 13:57:29.541281 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 222/446] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:28 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:30.070449 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f156ff66-9560-45c1-bd8e-927a9f3f516f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:30.071272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f156ff66-9560-45c1-bd8e-927a9f3f516f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:30.088579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f156ff66-9560-45c1-bd8e-927a9f3f516f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:30.089143 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f156ff66-9560-45c1-bd8e-927a9f3f516f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:30.090088 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f156ff66-9560-45c1-bd8e-927a9f3f516f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:30.090701 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f156ff66-9560-45c1-bd8e-927a9f3f516f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:30.281174 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f156ff66-9560-45c1-bd8e-927a9f3f516f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:30.295644 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f156ff66-9560-45c1-bd8e-927a9f3f516f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.230117 May 19 13:57:30.296680 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 225/447] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:30 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:30.559020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:30.559626 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:30.575193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:30.576015 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:30.587458 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:30.588291 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:30.770911 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:30.784100 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:30.786302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:30.787865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-98017035-747a-4740-a7a2-659dfeb18398 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.233959 May 19 13:57:30.789003 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 223/448] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:30 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:31.316722 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c9f7619b-1498-46d0-b1a9-b9807a709b92 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:31.317960 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c9f7619b-1498-46d0-b1a9-b9807a709b92 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:31.325900 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9f7619b-1498-46d0-b1a9-b9807a709b92 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:31.326692 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9f7619b-1498-46d0-b1a9-b9807a709b92 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:31.327848 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9f7619b-1498-46d0-b1a9-b9807a709b92 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:31.328548 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9f7619b-1498-46d0-b1a9-b9807a709b92 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:31.477140 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c9f7619b-1498-46d0-b1a9-b9807a709b92 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:31.487551 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c9f7619b-1498-46d0-b1a9-b9807a709b92 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.175982 May 19 13:57:31.488233 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 226/449] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:31 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:31.805767 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:31.806465 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:31.809153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=22 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:31.810094 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:31.817841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:31.818400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:31.819201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:31.819631 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:31.972292 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:31.980210 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:31.981703 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:31.982882 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-69e11a45-1877-4d55-a3c7-f110c7b27c7f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.181229 May 19 13:57:31.983433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 224/450] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:31 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:32.504731 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-35996299-b69b-4cf9-8b77-34377ff4f1b2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:32.505263 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-35996299-b69b-4cf9-8b77-34377ff4f1b2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:32.511741 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35996299-b69b-4cf9-8b77-34377ff4f1b2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:32.512190 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35996299-b69b-4cf9-8b77-34377ff4f1b2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:32.512967 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35996299-b69b-4cf9-8b77-34377ff4f1b2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:32.513386 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-35996299-b69b-4cf9-8b77-34377ff4f1b2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:32.647714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-35996299-b69b-4cf9-8b77-34377ff4f1b2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:32.655472 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-35996299-b69b-4cf9-8b77-34377ff4f1b2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.154860 May 19 13:57:32.656198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 227/451] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:32 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:33.005933 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:33.006824 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:33.013958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:33.014487 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:33.015357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:33.015789 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:33.153590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:33.163872 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:33.165484 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:33.166658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2fc8b514-c78b-4aa1-96f6-b4cca4def9ff tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.165577 May 19 13:57:33.170549 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 225/452] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:32 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:33.672852 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-56c614af-0e5c-42f4-b535-d6307098d189 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:33.674311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-56c614af-0e5c-42f4-b535-d6307098d189 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:33.681349 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56c614af-0e5c-42f4-b535-d6307098d189 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:33.681801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56c614af-0e5c-42f4-b535-d6307098d189 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:33.682577 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56c614af-0e5c-42f4-b535-d6307098d189 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:33.683045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56c614af-0e5c-42f4-b535-d6307098d189 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:33.844336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-56c614af-0e5c-42f4-b535-d6307098d189 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:33.852628 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-56c614af-0e5c-42f4-b535-d6307098d189 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.183767 May 19 13:57:33.853206 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 228/453] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:33 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:34.186057 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:34.186667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:34.194182 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:34.194625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:34.195420 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:34.195850 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:34.348445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:34.357273 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:34.359021 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:34.360239 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b4eb340d-6762-4cf6-a529-d2524848f3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.178337 May 19 13:57:34.361008 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 226/454] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:34 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:34.480100 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-ca352107-0d56-4acc-b4cf-d7b8a511a7f6 req-0173636c-58ba-4741-a730-38c4d28e6d6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e2c2f-4753-4911-8859-73736543f959", "name": "network-vif-unplugged", "status": "completed", "tag": "5e326997-1358-457a-8426-4184a94bfdad"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:34.489597 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ca352107-0d56-4acc-b4cf-d7b8a511a7f6 req-0173636c-58ba-4741-a730-38c4d28e6d6c service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:34.490286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ca352107-0d56-4acc-b4cf-d7b8a511a7f6 req-0173636c-58ba-4741-a730-38c4d28e6d6c service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:34.506918 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-ca352107-0d56-4acc-b4cf-d7b8a511a7f6 req-0173636c-58ba-4741-a730-38c4d28e6d6c service nova] Creating event network-vif-unplugged:5e326997-1358-457a-8426-4184a94bfdad for instance 5c4e2c2f-4753-4911-8859-73736543f959 on hv-cinder-78481 May 19 13:57:34.513110 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-ca352107-0d56-4acc-b4cf-d7b8a511a7f6 req-0173636c-58ba-4741-a730-38c4d28e6d6c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038948 May 19 13:57:34.513723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 229/455] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:34.869775 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-39bb5650-ece7-4b3a-ba26-34ef5181f66a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:34.870479 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-39bb5650-ece7-4b3a-ba26-34ef5181f66a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:34.877168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-39bb5650-ece7-4b3a-ba26-34ef5181f66a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:34.877606 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-39bb5650-ece7-4b3a-ba26-34ef5181f66a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:34.878416 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-39bb5650-ece7-4b3a-ba26-34ef5181f66a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:34.878848 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-39bb5650-ece7-4b3a-ba26-34ef5181f66a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:35.016077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-39bb5650-ece7-4b3a-ba26-34ef5181f66a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:35.024980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-39bb5650-ece7-4b3a-ba26-34ef5181f66a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.159257 May 19 13:57:35.025481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 227/456] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:34 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:35.382335 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:35.383302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:35.390113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:35.390849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:35.391821 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:35.392252 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:35.527998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:35.537183 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:35.538940 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:35.540092 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4dfe606b-c7c9-4944-9bb4-5ee2921c4f3a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1738 microversion: 2.20 time: 0.163073 May 19 13:57:35.540645 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 230/457] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:35 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:36.041536 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6bb0bbd7-743c-4c2f-b90e-4d0cf535b1d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:36.042150 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6bb0bbd7-743c-4c2f-b90e-4d0cf535b1d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:36.049005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6bb0bbd7-743c-4c2f-b90e-4d0cf535b1d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:36.049459 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6bb0bbd7-743c-4c2f-b90e-4d0cf535b1d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:36.050225 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6bb0bbd7-743c-4c2f-b90e-4d0cf535b1d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:36.050845 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6bb0bbd7-743c-4c2f-b90e-4d0cf535b1d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:36.053713 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:36.226826 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6bb0bbd7-743c-4c2f-b90e-4d0cf535b1d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:36.235232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6bb0bbd7-743c-4c2f-b90e-4d0cf535b1d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.197406 May 19 13:57:36.235835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 228/458] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:36 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:36.558405 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:36.559047 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:36.566986 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:36.567438 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:36.568242 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:36.568703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:36.710172 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:36.717942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:36.719578 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:36.720727 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e47d41ad-bce8-480c-985d-40e32c5f9be9 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1720 microversion: 2.20 time: 0.166207 May 19 13:57:36.721403 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 231/459] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:36 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:37.252055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e46397cc-ab1d-4730-aff1-f84764fdc88a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:37.252668 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e46397cc-ab1d-4730-aff1-f84764fdc88a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:37.259359 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e46397cc-ab1d-4730-aff1-f84764fdc88a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:37.259805 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e46397cc-ab1d-4730-aff1-f84764fdc88a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:37.260567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e46397cc-ab1d-4730-aff1-f84764fdc88a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:37.260995 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e46397cc-ab1d-4730-aff1-f84764fdc88a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:37.478643 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e46397cc-ab1d-4730-aff1-f84764fdc88a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:37.489508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e46397cc-ab1d-4730-aff1-f84764fdc88a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.241961 May 19 13:57:37.490276 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 229/460] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:37 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:37.740806 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:37.741337 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:37.747888 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:37.748337 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:37.749215 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:37.749948 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:37.894299 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:37.903356 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:37.904858 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:37.906608 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9c57e981-e20d-4531-9764-62c28b9a83bf tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1720 microversion: 2.20 time: 0.169774 May 19 13:57:37.907201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 232/461] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:37 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:38.506354 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6122230b-17a4-49cf-8717-6bdb5627f75c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:38.507077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6122230b-17a4-49cf-8717-6bdb5627f75c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:38.514698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6122230b-17a4-49cf-8717-6bdb5627f75c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:38.514698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6122230b-17a4-49cf-8717-6bdb5627f75c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:38.515675 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6122230b-17a4-49cf-8717-6bdb5627f75c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:38.516207 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6122230b-17a4-49cf-8717-6bdb5627f75c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:38.653024 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6122230b-17a4-49cf-8717-6bdb5627f75c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:38.660898 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6122230b-17a4-49cf-8717-6bdb5627f75c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.158371 May 19 13:57:38.661455 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 230/462] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:38 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:38.925684 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:38.926225 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:38.932665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:38.933110 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:38.933893 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:38.934323 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:39.070012 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:39.077926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:39.079441 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:39.080579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6e96c249-1c5d-4c5f-8f19-efcf81646ffd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1720 microversion: 2.20 time: 0.159473 May 19 13:57:39.081159 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 233/463] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:38 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:39.678138 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9cf42dc6-031b-450a-b16b-cff2124531d3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:39.678768 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9cf42dc6-031b-450a-b16b-cff2124531d3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:39.685231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9cf42dc6-031b-450a-b16b-cff2124531d3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:39.685671 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9cf42dc6-031b-450a-b16b-cff2124531d3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:39.686411 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9cf42dc6-031b-450a-b16b-cff2124531d3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:39.686839 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9cf42dc6-031b-450a-b16b-cff2124531d3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:39.821720 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9cf42dc6-031b-450a-b16b-cff2124531d3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:39.829130 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9cf42dc6-031b-450a-b16b-cff2124531d3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.155415 May 19 13:57:39.829760 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 231/464] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:39 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:40.099364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:40.099930 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:40.106270 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:40.106714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:40.107509 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:40.107941 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:40.110555 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=100 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:40.247894 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:40.256148 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:40.257612 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:40.258746 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8fdcf64a-69db-4e2f-ab8f-78794178eb09 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1720 microversion: 2.20 time: 0.163579 May 19 13:57:40.259328 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 234/465] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:40 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:40.847154 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8b932bc5-6a50-431a-a651-8e7d8372966f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:40.847946 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8b932bc5-6a50-431a-a651-8e7d8372966f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:40.855481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8b932bc5-6a50-431a-a651-8e7d8372966f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:40.855929 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8b932bc5-6a50-431a-a651-8e7d8372966f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:40.856696 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8b932bc5-6a50-431a-a651-8e7d8372966f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:40.857135 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8b932bc5-6a50-431a-a651-8e7d8372966f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:40.986486 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8b932bc5-6a50-431a-a651-8e7d8372966f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:40.994212 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8b932bc5-6a50-431a-a651-8e7d8372966f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.151394 May 19 13:57:40.994701 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 232/466] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:40 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:41.276410 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:41.276953 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:41.283375 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:41.283847 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:41.284618 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:41.285055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:41.416618 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:41.425285 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:41.426969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:41.428119 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6823784e-e197-4df7-922e-106ac8056f39 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1720 microversion: 2.20 time: 0.155759 May 19 13:57:41.428674 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 235/467] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:41 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:42.012113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-613eba5a-234c-40f7-9570-eedd38614dae tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:42.012820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-613eba5a-234c-40f7-9570-eedd38614dae tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:42.021240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-613eba5a-234c-40f7-9570-eedd38614dae tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:42.021775 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-613eba5a-234c-40f7-9570-eedd38614dae tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:42.022656 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-613eba5a-234c-40f7-9570-eedd38614dae tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:42.023243 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-613eba5a-234c-40f7-9570-eedd38614dae tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:42.177763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-613eba5a-234c-40f7-9570-eedd38614dae tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:42.185285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-613eba5a-234c-40f7-9570-eedd38614dae tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.177507 May 19 13:57:42.186070 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 233/468] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:42 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:42.447441 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:42.448382 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:42.456555 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:42.457008 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:42.457777 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:42.458235 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:42.599318 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:42.607324 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:42.608821 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:42.609953 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-31e1d488-c8b6-4682-b484-dc2f24d4545e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1723 microversion: 2.20 time: 0.166928 May 19 13:57:42.610490 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 236/469] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:42 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:42.628693 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-beb90200-ace0-4586-97b6-66105ac54f3d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "32718cf6-799c-4d56-b804-0b53ad86f817"}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:42.629803 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-beb90200-ace0-4586-97b6-66105ac54f3d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:42.635795 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-beb90200-ace0-4586-97b6-66105ac54f3d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:42.636237 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-beb90200-ace0-4586-97b6-66105ac54f3d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:42.636989 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-beb90200-ace0-4586-97b6-66105ac54f3d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:42.637416 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-beb90200-ace0-4586-97b6-66105ac54f3d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:42.927140 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-beb90200-ace0-4586-97b6-66105ac54f3d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303539 May 19 13:57:42.927727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 234/470] 10.222.0.52 () {62 vars in 1363 bytes} [Thu May 19 13:57:42 2022] POST /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:57:43.040516 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-773d57bd-4c3f-4c7a-b822-ec759e0e5c80 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:43.041081 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-773d57bd-4c3f-4c7a-b822-ec759e0e5c80 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:43.047018 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-773d57bd-4c3f-4c7a-b822-ec759e0e5c80 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:43.047470 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-773d57bd-4c3f-4c7a-b822-ec759e0e5c80 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:43.048228 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-773d57bd-4c3f-4c7a-b822-ec759e0e5c80 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:43.048667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-773d57bd-4c3f-4c7a-b822-ec759e0e5c80 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:43.144477 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-773d57bd-4c3f-4c7a-b822-ec759e0e5c80 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/action" status: 202 len: 0 microversion: 2.20 time: 0.107696 May 19 13:57:43.145133 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 237/471] 10.222.0.52 () {62 vars in 1318 bytes} [Thu May 19 13:57:43 2022] POST /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 13:57:43.153393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:43.154771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:43.162082 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:43.162633 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:43.163589 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:43.164093 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:43.201536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b809fe29-67ba-4ce4-9653-82152a78bda0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:43.202157 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b809fe29-67ba-4ce4-9653-82152a78bda0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:43.210208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b809fe29-67ba-4ce4-9653-82152a78bda0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:43.210656 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b809fe29-67ba-4ce4-9653-82152a78bda0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:43.211470 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b809fe29-67ba-4ce4-9653-82152a78bda0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:43.211908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b809fe29-67ba-4ce4-9653-82152a78bda0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:43.351918 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:43.360869 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:43.363133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:43.364537 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f1386901-3a0a-40ed-949f-2f8113295c36 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1749 microversion: 2.20 time: 0.215148 May 19 13:57:43.365278 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 235/472] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:43 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1749 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:43.379402 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b809fe29-67ba-4ce4-9653-82152a78bda0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:43.387051 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b809fe29-67ba-4ce4-9653-82152a78bda0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.189329 May 19 13:57:43.387621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 238/473] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:43 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:43.782307 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-0d503910-07ea-46df-a897-b0f4420cbc14 req-c9c305dc-0422-48ff-9fac-4910cd147176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282f0dfe-fd26-4a02-91e0-69716322d7d5", "name": "network-vif-plugged", "status": "completed", "tag": "e9f3edc9-7c52-4610-9122-024284dd285b"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:43.792687 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-0d503910-07ea-46df-a897-b0f4420cbc14 req-c9c305dc-0422-48ff-9fac-4910cd147176 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:43.793148 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-0d503910-07ea-46df-a897-b0f4420cbc14 req-c9c305dc-0422-48ff-9fac-4910cd147176 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:43.804723 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-0d503910-07ea-46df-a897-b0f4420cbc14 req-c9c305dc-0422-48ff-9fac-4910cd147176 service nova] Creating event network-vif-plugged:e9f3edc9-7c52-4610-9122-024284dd285b for instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 on hv-cinder-78481 May 19 13:57:43.810367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-0d503910-07ea-46df-a897-b0f4420cbc14 req-c9c305dc-0422-48ff-9fac-4910cd147176 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031919 May 19 13:57:43.811170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 236/474] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:44.384155 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:44.384763 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:44.391287 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:44.391732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:44.392492 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:44.392923 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:44.404635 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-95760614-44f6-4ca5-9906-05084b3b354d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:44.405325 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-95760614-44f6-4ca5-9906-05084b3b354d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:44.413073 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-95760614-44f6-4ca5-9906-05084b3b354d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:44.413879 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-95760614-44f6-4ca5-9906-05084b3b354d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:44.415220 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-95760614-44f6-4ca5-9906-05084b3b354d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:44.415877 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-95760614-44f6-4ca5-9906-05084b3b354d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:44.592513 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:44.600307 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-95760614-44f6-4ca5-9906-05084b3b354d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:44.601031 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:44.602517 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:44.603700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-61cd82ef-8f41-4872-bb80-e805245bb9df tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1749 microversion: 2.20 time: 0.223588 May 19 13:57:44.604256 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 239/475] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:44 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1749 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:44.607999 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-95760614-44f6-4ca5-9906-05084b3b354d tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.207537 May 19 13:57:44.608546 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 237/476] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:44 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:45.621884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:45.622498 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:45.625008 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-de050935-695f-4c71-a52d-1846cb8172f1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:45.625616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-de050935-695f-4c71-a52d-1846cb8172f1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:45.629969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:45.630423 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:45.631227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:45.631671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:45.632906 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de050935-695f-4c71-a52d-1846cb8172f1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:45.633357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de050935-695f-4c71-a52d-1846cb8172f1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:45.634110 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de050935-695f-4c71-a52d-1846cb8172f1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:45.634539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de050935-695f-4c71-a52d-1846cb8172f1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:45.827917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:45.833409 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-de050935-695f-4c71-a52d-1846cb8172f1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:45.837212 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:45.838703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:45.839887 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a706b282-415e-43ad-9c6e-12ebd9c48740 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1751 microversion: 2.20 time: 0.221978 May 19 13:57:45.840448 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 240/477] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:45 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:45.841074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-de050935-695f-4c71-a52d-1846cb8172f1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1358 microversion: 2.1 time: 0.219872 May 19 13:57:45.841711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 238/478] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:45 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:46.858736 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a9642e2f-4654-44d5-ab16-4ee74f89d3e9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:46.859287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:46.859763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:46.860536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a9642e2f-4654-44d5-ab16-4ee74f89d3e9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:46.867123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:46.867565 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:46.867700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9642e2f-4654-44d5-ab16-4ee74f89d3e9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:46.868040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9642e2f-4654-44d5-ab16-4ee74f89d3e9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:46.868325 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:46.868752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:46.868858 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9642e2f-4654-44d5-ab16-4ee74f89d3e9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:46.869238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9642e2f-4654-44d5-ab16-4ee74f89d3e9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:47.161676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a9642e2f-4654-44d5-ab16-4ee74f89d3e9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:47.168661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:47.172614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a9642e2f-4654-44d5-ab16-4ee74f89d3e9 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1547 microversion: 2.1 time: 0.317525 May 19 13:57:47.173842 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 241/479] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:46 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1547 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:47.190759 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:47.192841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:47.194190 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c1eb2245-cad5-4cbf-9358-980869b4f243 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.338956 May 19 13:57:47.195106 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 239/480] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:46 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:47.195799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-db65e5f2-eac9-4104-bd28-ef5887e4b9df tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:47.196414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-db65e5f2-eac9-4104-bd28-ef5887e4b9df tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:47.205694 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db65e5f2-eac9-4104-bd28-ef5887e4b9df tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:47.206333 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db65e5f2-eac9-4104-bd28-ef5887e4b9df tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:47.207902 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db65e5f2-eac9-4104-bd28-ef5887e4b9df tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:47.208651 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db65e5f2-eac9-4104-bd28-ef5887e4b9df tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:47.429848 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-db65e5f2-eac9-4104-bd28-ef5887e4b9df tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:47.437824 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-db65e5f2-eac9-4104-bd28-ef5887e4b9df tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1547 microversion: 2.1 time: 0.251406 May 19 13:57:47.450356 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 242/481] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:47 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1547 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:47.454154 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-683cf809-5078-48ea-81a4-08f760a3a6d0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:47.457702 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-683cf809-5078-48ea-81a4-08f760a3a6d0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:47.458676 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-683cf809-5078-48ea-81a4-08f760a3a6d0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Searching by: {'deleted': False, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2'} {{(pid=123751) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 13:57:47.465509 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-683cf809-5078-48ea-81a4-08f760a3a6d0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:47.465953 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-683cf809-5078-48ea-81a4-08f760a3a6d0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:47.466961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-683cf809-5078-48ea-81a4-08f760a3a6d0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:47.467398 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-683cf809-5078-48ea-81a4-08f760a3a6d0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:47.547741 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9c6c2d7b-9c33-4f81-ad31-9b822243d125 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71643f73-657e-40a8-b0ec-d984e6565363"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:47.549130 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9c6c2d7b-9c33-4f81-ad31-9b822243d125 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:47.560164 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.multi_cell_list [None req-683cf809-5078-48ea-81a4-08f760a3a6d0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123751) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 13:57:47.560891 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9c6c2d7b-9c33-4f81-ad31-9b822243d125 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:47.561895 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9c6c2d7b-9c33-4f81-ad31-9b822243d125 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:47.562977 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9c6c2d7b-9c33-4f81-ad31-9b822243d125 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:47.563583 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9c6c2d7b-9c33-4f81-ad31-9b822243d125 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:47.662180 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-683cf809-5078-48ea-81a4-08f760a3a6d0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211665 May 19 13:57:47.662765 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 240/482] 10.222.0.52 () {58 vars in 1124 bytes} [Thu May 19 13:57:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:57:47.673948 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7277e6ec-4b4c-442c-b075-972e63bdcd1c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:47.676534 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7277e6ec-4b4c-442c-b075-972e63bdcd1c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:47.684676 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7277e6ec-4b4c-442c-b075-972e63bdcd1c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:47.685396 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7277e6ec-4b4c-442c-b075-972e63bdcd1c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:47.686339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7277e6ec-4b4c-442c-b075-972e63bdcd1c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:47.686979 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7277e6ec-4b4c-442c-b075-972e63bdcd1c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:47.885958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7277e6ec-4b4c-442c-b075-972e63bdcd1c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:47.895573 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7277e6ec-4b4c-442c-b075-972e63bdcd1c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1547 microversion: 2.1 time: 0.225476 May 19 13:57:47.907329 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 241/483] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:47 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1547 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:47.939744 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9c6c2d7b-9c33-4f81-ad31-9b822243d125 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396165 May 19 13:57:47.948461 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 243/484] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 13:57:47 2022] POST /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:48.204823 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-785461447", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-788156017", "security_groups": [{"name": "tempest-secgroup-smoke-1758108947"}], "networks": [{"uuid": "54c8cc8a-69f9-403a-8e8d-3798fe8809d1"}], "block_device_mapping_v2": [{"uuid": "b28c401e-2f20-4171-9ab5-feabdd3e60fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:48.223047 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:48.225263 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:48.234088 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:48.234970 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:48.236269 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:48.237182 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:48.460099 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:48.463570 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] validate_networks() for [('54c8cc8a-69f9-403a-8e8d-3798fe8809d1', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:57:48.476416 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:48.480155 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:48.487888 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3a79703c-1d2c-4b61-8ca6-b0069f05243b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.272004 May 19 13:57:48.488954 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 244/485] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:48 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:49.148190 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:57:49.148707 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:57:49.149240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:57:49.149776 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:57:49.150177 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:57:49.160232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:49.161391 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:49.162333 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:49.162969 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:49.185477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Getting quotas for project 0197b4cff99649ef9da1e77b1461dd76. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:57:49.189640 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Getting quotas for user d5fabcc754684ded96c800be75777553 and project 0197b4cff99649ef9da1e77b1461dd76. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:57:49.258618 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:57:49.260730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b28c401e-2f20-4171-9ab5-feabdd3e60fa',volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:57:49.402396 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d203c6bd-836d-4abe-9c70-d85f6f2a061d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.202472 May 19 13:57:49.403066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 242/486] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:57:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:57:49.414497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a3ee349d-ed25-4b70-8038-be94d424b6ae tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:49.415354 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a3ee349d-ed25-4b70-8038-be94d424b6ae tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:49.497617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a3ee349d-ed25-4b70-8038-be94d424b6ae tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:49.507325 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a3ee349d-ed25-4b70-8038-be94d424b6ae tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1087 microversion: 2.1 time: 0.097056 May 19 13:57:49.508059 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:49.508988 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:49.509947 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 245/487] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:49 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1087 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:49.526743 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:49.528072 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:49.529721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:49.530184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:49.534247 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:49.707505 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:49.717330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:49.718841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:49.720026 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-97fc7c58-3356-4be0-a3b7-8612e22a4aeb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.217084 May 19 13:57:49.723011 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 243/488] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:49 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:49.726012 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-62bbbf76-5ce5-4bee-9236-eceb8fc54c5a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5ee2720-6939-4cba-80d1-d6aad87bd3b6"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:57:49.727390 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-62bbbf76-5ce5-4bee-9236-eceb8fc54c5a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:49.736484 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-62bbbf76-5ce5-4bee-9236-eceb8fc54c5a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:49.737723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-62bbbf76-5ce5-4bee-9236-eceb8fc54c5a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:49.738687 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-62bbbf76-5ce5-4bee-9236-eceb8fc54c5a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:49.739307 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-62bbbf76-5ce5-4bee-9236-eceb8fc54c5a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:50.525501 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6692bdb9-6860-41fb-b213-96590ff4f230 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:50.526130 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6692bdb9-6860-41fb-b213-96590ff4f230 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:50.532480 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6692bdb9-6860-41fb-b213-96590ff4f230 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:50.532920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6692bdb9-6860-41fb-b213-96590ff4f230 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:50.533706 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6692bdb9-6860-41fb-b213-96590ff4f230 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:50.534128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6692bdb9-6860-41fb-b213-96590ff4f230 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:50.601656 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6692bdb9-6860-41fb-b213-96590ff4f230 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:50.609198 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6692bdb9-6860-41fb-b213-96590ff4f230 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1137 microversion: 2.1 time: 0.087465 May 19 13:57:50.609940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 244/489] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:50 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:50.740439 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:50.741007 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:50.747211 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:50.747665 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:50.748433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:50.748871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:50.887715 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:50.897044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:50.898555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:50.899912 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c342f343-05f8-481f-8c8b-05480e6aebb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.163962 May 19 13:57:50.900339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 245/490] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:50 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:51.626247 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f02a5d79-0dd0-4e12-8892-abcc66796842 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:51.627003 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f02a5d79-0dd0-4e12-8892-abcc66796842 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:51.634315 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f02a5d79-0dd0-4e12-8892-abcc66796842 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:51.634790 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f02a5d79-0dd0-4e12-8892-abcc66796842 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:51.635585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f02a5d79-0dd0-4e12-8892-abcc66796842 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:51.636023 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f02a5d79-0dd0-4e12-8892-abcc66796842 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:51.706824 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f02a5d79-0dd0-4e12-8892-abcc66796842 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:51.715952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f02a5d79-0dd0-4e12-8892-abcc66796842 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1137 microversion: 2.1 time: 0.093124 May 19 13:57:51.716538 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 246/491] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:51 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:51.918191 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:51.918888 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:51.925609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:51.926161 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:51.926971 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:51.927410 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:52.096159 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:52.105375 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:52.107208 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:52.108550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-29d8838f-0ec5-4826-bc49-ea3a784bf90e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.194706 May 19 13:57:52.120286 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 247/492] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:51 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:52.733180 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-cfad6cba-77e9-482f-8437-5468bfcc2e3e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:52.733980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-cfad6cba-77e9-482f-8437-5468bfcc2e3e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:52.741109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-cfad6cba-77e9-482f-8437-5468bfcc2e3e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:52.741654 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-cfad6cba-77e9-482f-8437-5468bfcc2e3e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:52.742451 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-cfad6cba-77e9-482f-8437-5468bfcc2e3e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:52.742906 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-cfad6cba-77e9-482f-8437-5468bfcc2e3e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:52.811978 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-cfad6cba-77e9-482f-8437-5468bfcc2e3e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:52.837246 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-cfad6cba-77e9-482f-8437-5468bfcc2e3e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1137 microversion: 2.1 time: 0.107676 May 19 13:57:52.837881 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 248/493] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:52 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1137 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:53.127848 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:53.128583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:53.135213 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:53.135661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:53.136467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:53.136905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:53.274844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:53.284449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:53.285958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:53.287148 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-10c69e3f-4f96-48ab-aa85-0c8cb9a90607 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.163279 May 19 13:57:53.287710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 249/494] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:53 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:53.853741 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a540c142-4dd7-4271-b27d-b56ef74ca5d7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:53.854563 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a540c142-4dd7-4271-b27d-b56ef74ca5d7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:53.861012 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a540c142-4dd7-4271-b27d-b56ef74ca5d7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:53.861471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a540c142-4dd7-4271-b27d-b56ef74ca5d7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:53.863003 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a540c142-4dd7-4271-b27d-b56ef74ca5d7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:53.863449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a540c142-4dd7-4271-b27d-b56ef74ca5d7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:53.929325 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a540c142-4dd7-4271-b27d-b56ef74ca5d7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:53.937056 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a540c142-4dd7-4271-b27d-b56ef74ca5d7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1137 microversion: 2.1 time: 0.087043 May 19 13:57:53.937628 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 250/495] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:53 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:54.306099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:54.307293 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:54.313650 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:54.314104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:54.315485 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:54.315936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:54.464727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:54.474021 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:54.475686 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:54.476920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2c2be2e0-cf21-401a-95ea-061fba6ed01d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.174851 May 19 13:57:54.477615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 251/496] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:54 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:54.954080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8d6ce93e-aa30-4cd1-b7ee-e85558fd6aad tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:54.954931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8d6ce93e-aa30-4cd1-b7ee-e85558fd6aad tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:54.961843 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8d6ce93e-aa30-4cd1-b7ee-e85558fd6aad tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:54.962379 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8d6ce93e-aa30-4cd1-b7ee-e85558fd6aad tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:54.963258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8d6ce93e-aa30-4cd1-b7ee-e85558fd6aad tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:54.963729 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8d6ce93e-aa30-4cd1-b7ee-e85558fd6aad tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:55.027236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8d6ce93e-aa30-4cd1-b7ee-e85558fd6aad tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:55.034992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8d6ce93e-aa30-4cd1-b7ee-e85558fd6aad tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1137 microversion: 2.1 time: 0.085219 May 19 13:57:55.035582 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 252/497] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:54 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:55.495900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:55.496512 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:55.502617 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:55.503367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:55.504197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:55.504895 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:55.637920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:55.647441 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:55.649173 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:55.650435 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b026b2b2-316e-49c7-b9ca-8d043f521918 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.158444 May 19 13:57:55.651317 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 253/498] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:55 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:56.056607 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-656b61b3-e092-4006-bda4-0855fa49b9b4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:56.057364 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-656b61b3-e092-4006-bda4-0855fa49b9b4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:56.064060 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-656b61b3-e092-4006-bda4-0855fa49b9b4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:56.064517 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-656b61b3-e092-4006-bda4-0855fa49b9b4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:56.065308 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-656b61b3-e092-4006-bda4-0855fa49b9b4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:56.066352 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-656b61b3-e092-4006-bda4-0855fa49b9b4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:56.143368 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-656b61b3-e092-4006-bda4-0855fa49b9b4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:56.152929 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-656b61b3-e092-4006-bda4-0855fa49b9b4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1137 microversion: 2.1 time: 0.100372 May 19 13:57:56.153496 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 254/499] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:56 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1137 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:56.669206 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:56.670056 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:56.676913 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:56.677444 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:56.678293 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:56.678833 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:56.823510 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:56.835365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:56.836877 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:56.838057 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8759795a-39c2-415b-9871-cbe6b9dd32f4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.172814 May 19 13:57:56.838621 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 255/500] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:56 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:57:57.170811 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-13143e1a-0350-4713-8823-46cdc02ce647 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:57.171684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-13143e1a-0350-4713-8823-46cdc02ce647 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:57.178351 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-13143e1a-0350-4713-8823-46cdc02ce647 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:57.179060 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-13143e1a-0350-4713-8823-46cdc02ce647 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:57.179853 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-13143e1a-0350-4713-8823-46cdc02ce647 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:57.180296 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-13143e1a-0350-4713-8823-46cdc02ce647 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:57.246275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-13143e1a-0350-4713-8823-46cdc02ce647 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:57.254222 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-13143e1a-0350-4713-8823-46cdc02ce647 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1137 microversion: 2.1 time: 0.087304 May 19 13:57:57.255083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 256/501] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:57 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1137 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:57:57.857315 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:57.857958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:57.864282 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:57.864731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:57.865495 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:57.865945 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:57.998756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-62bbbf76-5ce5-4bee-9236-eceb8fc54c5a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "POST /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.276541 May 19 13:57:58.004884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 246/502] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 13:57:49 2022] POST /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments => generated 194 bytes in 8283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:57:58.015742 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:58.024320 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:58.025873 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:58.027066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a7c87f57-1328-42f1-a566-110f9a59d93d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.173670 May 19 13:57:58.027631 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 257/503] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:57 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:58.273187 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f325061d-8ae0-4d0d-b09b-7429d4d883dc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:58.273803 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f325061d-8ae0-4d0d-b09b-7429d4d883dc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:58.279977 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f325061d-8ae0-4d0d-b09b-7429d4d883dc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:58.280420 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f325061d-8ae0-4d0d-b09b-7429d4d883dc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:58.281172 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f325061d-8ae0-4d0d-b09b-7429d4d883dc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:58.281606 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f325061d-8ae0-4d0d-b09b-7429d4d883dc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:58.341834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f325061d-8ae0-4d0d-b09b-7429d4d883dc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:58.349307 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f325061d-8ae0-4d0d-b09b-7429d4d883dc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1129 microversion: 2.1 time: 0.081562 May 19 13:57:58.349859 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 247/504] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:58 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1129 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:57:59.045601 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:59.046217 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:59.053561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:59.054014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:59.054780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:59.055249 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:59.174891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=4 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:59.185254 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:59.193408 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:59.195128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:59.196285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3066b31a-2c72-4b9d-bf02-15ee8e843947 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.154685 May 19 13:57:59.196836 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 258/505] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:57:59 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:57:59.366450 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d9feb0aa-8a46-4f15-a3ef-0b13d0ce862e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:57:59.367119 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d9feb0aa-8a46-4f15-a3ef-0b13d0ce862e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:57:59.369482 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=54 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:59.375083 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d9feb0aa-8a46-4f15-a3ef-0b13d0ce862e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:59.375562 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d9feb0aa-8a46-4f15-a3ef-0b13d0ce862e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:59.376322 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d9feb0aa-8a46-4f15-a3ef-0b13d0ce862e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:57:59.376756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d9feb0aa-8a46-4f15-a3ef-0b13d0ce862e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:57:59.381523 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:57:59.443394 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d9feb0aa-8a46-4f15-a3ef-0b13d0ce862e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:57:59.450716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d9feb0aa-8a46-4f15-a3ef-0b13d0ce862e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1185 microversion: 2.1 time: 0.088856 May 19 13:57:59.451303 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 248/506] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:57:59 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:00.214345 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:00.214983 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:00.216925 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=6 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:00.225620 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:00.226088 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:00.226889 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:00.227337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:00.446548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:00.448801 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:00.457146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:00.458780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:00.460009 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e666b73d-951a-4338-ba2b-416ccd16791b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.249570 May 19 13:58:00.460562 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 259/507] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:00 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:00.468284 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-76a18590-422e-4622-8813-5bf51aa2e3a1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:00.469104 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-76a18590-422e-4622-8813-5bf51aa2e3a1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:00.471049 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:00.477140 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76a18590-422e-4622-8813-5bf51aa2e3a1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:00.477590 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76a18590-422e-4622-8813-5bf51aa2e3a1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:00.478435 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76a18590-422e-4622-8813-5bf51aa2e3a1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:00.478885 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76a18590-422e-4622-8813-5bf51aa2e3a1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:00.545897 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-76a18590-422e-4622-8813-5bf51aa2e3a1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:00.553496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-76a18590-422e-4622-8813-5bf51aa2e3a1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1203 microversion: 2.1 time: 0.089259 May 19 13:58:00.554073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 249/508] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:00 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1203 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:00.801147 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4a91c6f7-07ba-4430-a633-5c401bdb1ce3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:00.802145 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4a91c6f7-07ba-4430-a633-5c401bdb1ce3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:00.808114 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a91c6f7-07ba-4430-a633-5c401bdb1ce3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:00.808565 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a91c6f7-07ba-4430-a633-5c401bdb1ce3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:00.809322 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a91c6f7-07ba-4430-a633-5c401bdb1ce3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:00.809753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a91c6f7-07ba-4430-a633-5c401bdb1ce3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:00.834477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-4a91c6f7-07ba-4430-a633-5c401bdb1ce3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lazy-loading 'flavor' on Instance uuid 83247503-3bc5-4f4d-9221-acd8b14033e8 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:58:00.964462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4a91c6f7-07ba-4430-a633-5c401bdb1ce3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/action" status: 200 len: 32 microversion: 2.1 time: 0.167789 May 19 13:58:00.965114 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 260/509] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 13:58:00 2022] POST /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:58:00.975514 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9193b8ab-586b-44e4-9112-dfc2094f9e12 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:00.976103 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9193b8ab-586b-44e4-9112-dfc2094f9e12 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:00.983266 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9193b8ab-586b-44e4-9112-dfc2094f9e12 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:00.984040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9193b8ab-586b-44e4-9112-dfc2094f9e12 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:00.984919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9193b8ab-586b-44e4-9112-dfc2094f9e12 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:00.985603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9193b8ab-586b-44e4-9112-dfc2094f9e12 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:01.187371 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9193b8ab-586b-44e4-9112-dfc2094f9e12 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:01.197233 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9193b8ab-586b-44e4-9112-dfc2094f9e12 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.226268 May 19 13:58:01.198530 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 250/510] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:00 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:01.489818 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:01.492740 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:01.495944 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-3e622a7d-ddba-47a2-9977-04a1cb1cfdf4 req-f10f2b73-f024-492b-9b4e-0f2c4301245c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ccab6e9-3133-4db9-a8d9-27c83353c00a", "tag": "80eac5d4-3a31-4ac5-b15f-b7109c704ba1"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:01.508066 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:01.508520 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:01.509313 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:01.522279 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-3e622a7d-ddba-47a2-9977-04a1cb1cfdf4 req-f10f2b73-f024-492b-9b4e-0f2c4301245c service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:01.522725 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-3e622a7d-ddba-47a2-9977-04a1cb1cfdf4 req-f10f2b73-f024-492b-9b4e-0f2c4301245c service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:01.528163 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:01.551445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-3e622a7d-ddba-47a2-9977-04a1cb1cfdf4 req-f10f2b73-f024-492b-9b4e-0f2c4301245c service nova] Creating event network-changed:80eac5d4-3a31-4ac5-b15f-b7109c704ba1 for instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a on hv-cinder-78481 May 19 13:58:01.559463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-3e622a7d-ddba-47a2-9977-04a1cb1cfdf4 req-f10f2b73-f024-492b-9b4e-0f2c4301245c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088544 May 19 13:58:01.564779 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 261/511] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:01.570708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1f4c1dec-94ce-4ee2-bf0e-8e6a16250834 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:01.573336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1f4c1dec-94ce-4ee2-bf0e-8e6a16250834 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:01.580081 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f4c1dec-94ce-4ee2-bf0e-8e6a16250834 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:01.580730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f4c1dec-94ce-4ee2-bf0e-8e6a16250834 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:01.582389 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f4c1dec-94ce-4ee2-bf0e-8e6a16250834 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:01.583120 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f4c1dec-94ce-4ee2-bf0e-8e6a16250834 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:01.827209 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:01.837110 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:01.838607 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:01.839785 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b3b26280-81d1-4dc4-bc49-60ed6276cff8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.364352 May 19 13:58:01.840334 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 251/512] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:01 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:01.852520 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1f4c1dec-94ce-4ee2-bf0e-8e6a16250834 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:01.860179 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1f4c1dec-94ce-4ee2-bf0e-8e6a16250834 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1271 microversion: 2.1 time: 0.293940 May 19 13:58:01.860745 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 262/513] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:01 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1271 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:02.214640 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-18705102-b5f9-4e63-b2a2-174a067ae491 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:02.215287 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-18705102-b5f9-4e63-b2a2-174a067ae491 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:02.221940 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18705102-b5f9-4e63-b2a2-174a067ae491 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:02.222526 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18705102-b5f9-4e63-b2a2-174a067ae491 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:02.223370 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18705102-b5f9-4e63-b2a2-174a067ae491 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:02.223811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18705102-b5f9-4e63-b2a2-174a067ae491 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:02.438708 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-18705102-b5f9-4e63-b2a2-174a067ae491 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:02.447049 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-18705102-b5f9-4e63-b2a2-174a067ae491 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.236282 May 19 13:58:02.447852 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 252/514] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:02 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:02.858200 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:02.858817 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:02.861285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:02.867565 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:02.868019 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:02.868786 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:02.869225 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:02.877377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ee5cdd96-cf8c-4543-b2f1-b8e23ab5ad7e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:02.877997 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ee5cdd96-cf8c-4543-b2f1-b8e23ab5ad7e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:02.884259 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ee5cdd96-cf8c-4543-b2f1-b8e23ab5ad7e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:02.884712 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ee5cdd96-cf8c-4543-b2f1-b8e23ab5ad7e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:02.885476 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ee5cdd96-cf8c-4543-b2f1-b8e23ab5ad7e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:02.885912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ee5cdd96-cf8c-4543-b2f1-b8e23ab5ad7e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:03.064835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:03.073512 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ee5cdd96-cf8c-4543-b2f1-b8e23ab5ad7e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:03.073845 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:03.075391 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:03.076561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a5dbdd48-5074-47db-a016-a4645065d7ae tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.222283 May 19 13:58:03.077118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 263/515] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:02 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:03.082141 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ee5cdd96-cf8c-4543-b2f1-b8e23ab5ad7e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1271 microversion: 2.1 time: 0.207906 May 19 13:58:03.082838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 253/516] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:02 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:03.465126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9b797a87-d546-4c04-8d1c-25a09a6d411d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:03.465741 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9b797a87-d546-4c04-8d1c-25a09a6d411d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:03.471817 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b797a87-d546-4c04-8d1c-25a09a6d411d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:03.472439 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b797a87-d546-4c04-8d1c-25a09a6d411d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:03.473225 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b797a87-d546-4c04-8d1c-25a09a6d411d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:03.473667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9b797a87-d546-4c04-8d1c-25a09a6d411d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:03.599342 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9b797a87-d546-4c04-8d1c-25a09a6d411d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:03.607252 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9b797a87-d546-4c04-8d1c-25a09a6d411d tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.145925 May 19 13:58:03.607825 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 264/517] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:03 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:04.095275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:04.095894 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:04.099140 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b6bc5989-cdb0-4442-a638-6eedaea15461 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:04.099762 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b6bc5989-cdb0-4442-a638-6eedaea15461 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:04.103310 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:04.103759 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:04.104523 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:04.104954 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:04.106186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b6bc5989-cdb0-4442-a638-6eedaea15461 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:04.106672 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b6bc5989-cdb0-4442-a638-6eedaea15461 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:04.107488 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b6bc5989-cdb0-4442-a638-6eedaea15461 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:04.107922 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b6bc5989-cdb0-4442-a638-6eedaea15461 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:04.302293 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:04.310687 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b6bc5989-cdb0-4442-a638-6eedaea15461 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:04.310845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:04.312291 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:04.313454 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3da68eae-9da1-4033-82ce-c78cf9ada3cb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.222094 May 19 13:58:04.314020 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 254/518] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:04 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:04.318392 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b6bc5989-cdb0-4442-a638-6eedaea15461 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1271 microversion: 2.1 time: 0.223832 May 19 13:58:04.319240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 265/519] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:04 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1271 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:04.624223 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-30506fb9-f72a-46e9-b9bc-a000b2e2a313 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:04.624831 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-30506fb9-f72a-46e9-b9bc-a000b2e2a313 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:04.631150 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-30506fb9-f72a-46e9-b9bc-a000b2e2a313 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:04.631601 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-30506fb9-f72a-46e9-b9bc-a000b2e2a313 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:04.632353 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-30506fb9-f72a-46e9-b9bc-a000b2e2a313 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:04.632785 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-30506fb9-f72a-46e9-b9bc-a000b2e2a313 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:04.760584 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-30506fb9-f72a-46e9-b9bc-a000b2e2a313 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:04.768561 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-30506fb9-f72a-46e9-b9bc-a000b2e2a313 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.148111 May 19 13:58:04.769863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 255/520] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:04 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:05.332354 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:05.332965 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:05.334978 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5dca50ac-3303-4e80-9793-d2853ef84378 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:05.335673 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5dca50ac-3303-4e80-9793-d2853ef84378 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:05.339492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:05.339941 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:05.340696 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:05.341133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:05.342067 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5dca50ac-3303-4e80-9793-d2853ef84378 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:05.342521 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5dca50ac-3303-4e80-9793-d2853ef84378 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:05.343317 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5dca50ac-3303-4e80-9793-d2853ef84378 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:05.343760 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5dca50ac-3303-4e80-9793-d2853ef84378 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:05.529800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5dca50ac-3303-4e80-9793-d2853ef84378 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:05.537318 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5dca50ac-3303-4e80-9793-d2853ef84378 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1271 microversion: 2.1 time: 0.206230 May 19 13:58:05.537888 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 256/521] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:05 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:05.543458 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:05.552343 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:05.553940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:05.555135 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3a4ebf3e-a728-410f-8f03-2239e28b7373 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.227199 May 19 13:58:05.555691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 266/522] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:05 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:05.786013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-010e1062-c05d-4070-8056-2fc3db4b63e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:05.786640 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-010e1062-c05d-4070-8056-2fc3db4b63e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:05.792745 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-010e1062-c05d-4070-8056-2fc3db4b63e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:05.793191 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-010e1062-c05d-4070-8056-2fc3db4b63e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:05.793979 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-010e1062-c05d-4070-8056-2fc3db4b63e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:05.794411 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-010e1062-c05d-4070-8056-2fc3db4b63e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:05.929078 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-010e1062-c05d-4070-8056-2fc3db4b63e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:05.937048 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-010e1062-c05d-4070-8056-2fc3db4b63e4 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.155534 May 19 13:58:05.937603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 257/523] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:05 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:06.554518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-63e3cbac-9ab7-4988-bb38-fcc8e9e8c356 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:06.556350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-63e3cbac-9ab7-4988-bb38-fcc8e9e8c356 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:06.564872 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63e3cbac-9ab7-4988-bb38-fcc8e9e8c356 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:06.574501 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:06.575500 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:06.580504 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63e3cbac-9ab7-4988-bb38-fcc8e9e8c356 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:06.583482 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63e3cbac-9ab7-4988-bb38-fcc8e9e8c356 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:06.584240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63e3cbac-9ab7-4988-bb38-fcc8e9e8c356 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:06.588288 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:06.589633 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:06.592973 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:06.593671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:06.785298 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-63e3cbac-9ab7-4988-bb38-fcc8e9e8c356 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:06.789190 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:06.793030 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-63e3cbac-9ab7-4988-bb38-fcc8e9e8c356 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1271 microversion: 2.1 time: 0.242920 May 19 13:58:06.793717 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 267/524] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:06 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:06.798174 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-cb1770bc-2de2-4229-a6fb-ecd46edcba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:06.798825 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-cb1770bc-2de2-4229-a6fb-ecd46edcba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:06.804014 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:06.805046 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-cb1770bc-2de2-4229-a6fb-ecd46edcba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:06.805502 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-cb1770bc-2de2-4229-a6fb-ecd46edcba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:06.805627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:06.806265 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-cb1770bc-2de2-4229-a6fb-ecd46edcba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:06.806701 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-cb1770bc-2de2-4229-a6fb-ecd46edcba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:06.806800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2367546e-9d01-4a17-81d5-fb40f7e7ad0c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.236510 May 19 13:58:06.807295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 258/525] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:06 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:06.933737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-cb1770bc-2de2-4229-a6fb-ecd46edcba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:06.942209 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-cb1770bc-2de2-4229-a6fb-ecd46edcba60 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1593 microversion: 2.1 time: 0.147557 May 19 13:58:06.942766 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 268/526] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:06 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1593 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:06.953409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-866a7ba4-632d-4737-a0c6-acdc1d9c5d8a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:06.953833 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-866a7ba4-632d-4737-a0c6-acdc1d9c5d8a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:06.960068 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-866a7ba4-632d-4737-a0c6-acdc1d9c5d8a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:06.960515 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-866a7ba4-632d-4737-a0c6-acdc1d9c5d8a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:06.961297 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-866a7ba4-632d-4737-a0c6-acdc1d9c5d8a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:06.961732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-866a7ba4-632d-4737-a0c6-acdc1d9c5d8a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:07.101457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-866a7ba4-632d-4737-a0c6-acdc1d9c5d8a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:07.109608 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-866a7ba4-632d-4737-a0c6-acdc1d9c5d8a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.160132 May 19 13:58:07.110388 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 259/527] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:06 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:07.810183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c36377bd-d706-47ad-b466-f44f2c96255e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:07.810805 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c36377bd-d706-47ad-b466-f44f2c96255e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:07.818182 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c36377bd-d706-47ad-b466-f44f2c96255e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:07.820096 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c36377bd-d706-47ad-b466-f44f2c96255e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:07.821162 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c36377bd-d706-47ad-b466-f44f2c96255e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:07.821803 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c36377bd-d706-47ad-b466-f44f2c96255e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:07.843862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:07.844465 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:07.857799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:07.858248 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:07.859409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:07.859847 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:08.375616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c36377bd-d706-47ad-b466-f44f2c96255e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:08.384898 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c36377bd-d706-47ad-b466-f44f2c96255e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1259 microversion: 2.1 time: 0.578510 May 19 13:58:08.395288 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 269/528] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:07 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1259 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:08.395824 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-71376340-2805-4de9-8a9e-cd7741f1fae9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:08.396441 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-71376340-2805-4de9-8a9e-cd7741f1fae9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:08.403424 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-71376340-2805-4de9-8a9e-cd7741f1fae9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:08.403827 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:08.403970 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-71376340-2805-4de9-8a9e-cd7741f1fae9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:08.405964 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-71376340-2805-4de9-8a9e-cd7741f1fae9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:08.406628 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-71376340-2805-4de9-8a9e-cd7741f1fae9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:08.416548 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:08.419287 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:08.420629 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-24296f42-deb7-40ec-b755-bbec094581da tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.595948 May 19 13:58:08.431649 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 260/529] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:07 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:08.643099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-71376340-2805-4de9-8a9e-cd7741f1fae9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:08.652149 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-71376340-2805-4de9-8a9e-cd7741f1fae9 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.260868 May 19 13:58:08.652726 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 270/530] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:08 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:09.209855 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-18a0f18f-f5df-43a0-98f4-373bedd90303 req-fb586035-f6ad-4309-9923-8f67031cd0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282f0dfe-fd26-4a02-91e0-69716322d7d5", "tag": "e9f3edc9-7c52-4610-9122-024284dd285b"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:09.218474 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-18a0f18f-f5df-43a0-98f4-373bedd90303 req-fb586035-f6ad-4309-9923-8f67031cd0f7 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:09.218937 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-18a0f18f-f5df-43a0-98f4-373bedd90303 req-fb586035-f6ad-4309-9923-8f67031cd0f7 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:09.232693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-18a0f18f-f5df-43a0-98f4-373bedd90303 req-fb586035-f6ad-4309-9923-8f67031cd0f7 service nova] Creating event network-changed:e9f3edc9-7c52-4610-9122-024284dd285b for instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 on hv-cinder-78481 May 19 13:58:09.238665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-18a0f18f-f5df-43a0-98f4-373bedd90303 req-fb586035-f6ad-4309-9923-8f67031cd0f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032858 May 19 13:58:09.239700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 261/531] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:09.412538 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-29bb197c-afda-4452-9727-a33ce031fa48 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:09.414440 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-29bb197c-afda-4452-9727-a33ce031fa48 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:09.424633 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-29bb197c-afda-4452-9727-a33ce031fa48 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:09.425355 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-29bb197c-afda-4452-9727-a33ce031fa48 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:09.426324 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-29bb197c-afda-4452-9727-a33ce031fa48 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:09.426945 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-29bb197c-afda-4452-9727-a33ce031fa48 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:09.441379 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:09.442196 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:09.454944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:09.455397 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:09.456757 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:09.457192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:09.791361 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-29bb197c-afda-4452-9727-a33ce031fa48 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:09.796518 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:09.816410 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-29bb197c-afda-4452-9727-a33ce031fa48 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1259 microversion: 2.1 time: 0.416176 May 19 13:58:09.826597 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 271/532] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:09 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1259 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:09.828700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:09.836819 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:09.838286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f6b6ca55-5afa-46ba-8a7e-2fdf73f89d6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.402714 May 19 13:58:09.853653 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f2da2ef2-e58d-48be-9ade-495b95a67cea tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:09.854289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f2da2ef2-e58d-48be-9ade-495b95a67cea tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:09.856420 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 262/533] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:09 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:58:09.876422 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2da2ef2-e58d-48be-9ade-495b95a67cea tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:09.877100 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2da2ef2-e58d-48be-9ade-495b95a67cea tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:09.879524 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2da2ef2-e58d-48be-9ade-495b95a67cea tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:09.880426 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2da2ef2-e58d-48be-9ade-495b95a67cea tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:09.918156 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-79b28b94-c804-4711-b1d6-494df23e89a4 req-2ee0d180-d4cd-4c0b-a5e7-fa24f79c1dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e2c2f-4753-4911-8859-73736543f959", "name": "network-vif-plugged", "status": "completed", "tag": "5e326997-1358-457a-8426-4184a94bfdad"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:09.929243 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-79b28b94-c804-4711-b1d6-494df23e89a4 req-2ee0d180-d4cd-4c0b-a5e7-fa24f79c1dab service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:09.929689 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-79b28b94-c804-4711-b1d6-494df23e89a4 req-2ee0d180-d4cd-4c0b-a5e7-fa24f79c1dab service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:09.951832 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-79b28b94-c804-4711-b1d6-494df23e89a4 req-2ee0d180-d4cd-4c0b-a5e7-fa24f79c1dab service nova] Creating event network-vif-plugged:5e326997-1358-457a-8426-4184a94bfdad for instance 5c4e2c2f-4753-4911-8859-73736543f959 on hv-cinder-78481 May 19 13:58:09.970714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-79b28b94-c804-4711-b1d6-494df23e89a4 req-2ee0d180-d4cd-4c0b-a5e7-fa24f79c1dab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055847 May 19 13:58:09.973594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 263/534] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:10.141537 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f2da2ef2-e58d-48be-9ade-495b95a67cea tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:10.153218 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f2da2ef2-e58d-48be-9ade-495b95a67cea tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.324890 May 19 13:58:10.154187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 272/535] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:09 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:10.339065 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cd02e381-e30b-4244-a617-c693921c67bb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1189872962"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:10.339723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cd02e381-e30b-4244-a617-c693921c67bb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:10.348926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd02e381-e30b-4244-a617-c693921c67bb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:10.349370 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd02e381-e30b-4244-a617-c693921c67bb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:10.350142 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd02e381-e30b-4244-a617-c693921c67bb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:10.350592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd02e381-e30b-4244-a617-c693921c67bb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:10.551412 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.network.security_group_api [None req-cd02e381-e30b-4244-a617-c693921c67bb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Adding security group 763fc0df-a0f0-43b9-a4cb-14c8e8cdd173 to port e9f3edc9-7c52-4610-9122-024284dd285b May 19 13:58:10.833699 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-61dcd738-ee13-42d6-ba20-e68c1c58dddb tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:10.834325 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-61dcd738-ee13-42d6-ba20-e68c1c58dddb tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:10.840877 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-61dcd738-ee13-42d6-ba20-e68c1c58dddb tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:10.841327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-61dcd738-ee13-42d6-ba20-e68c1c58dddb tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:10.842084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-61dcd738-ee13-42d6-ba20-e68c1c58dddb tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:10.842519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-61dcd738-ee13-42d6-ba20-e68c1c58dddb tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:11.008799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cd02e381-e30b-4244-a617-c693921c67bb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "POST /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.676601 May 19 13:58:11.013538 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 264/536] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 13:58:10 2022] POST /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:58:11.020462 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:11.021416 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:11.029741 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:11.030563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:11.031682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:11.032329 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:11.055150 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-61dcd738-ee13-42d6-ba20-e68c1c58dddb tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:11.063189 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-61dcd738-ee13-42d6-ba20-e68c1c58dddb tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1259 microversion: 2.1 time: 0.233802 May 19 13:58:11.074988 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 273/537] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:10 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1259 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:11.079890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6c31f13e-812b-4889-8f3d-b4bef3421b3f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:11.080512 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6c31f13e-812b-4889-8f3d-b4bef3421b3f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:11.088898 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6c31f13e-812b-4889-8f3d-b4bef3421b3f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:11.089658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6c31f13e-812b-4889-8f3d-b4bef3421b3f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:11.090601 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6c31f13e-812b-4889-8f3d-b4bef3421b3f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:11.091361 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6c31f13e-812b-4889-8f3d-b4bef3421b3f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:11.217224 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:11.228648 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:11.230280 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:11.231744 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-55c6477a-2944-41ac-8417-b0261111d88c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.216980 May 19 13:58:11.232295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 265/538] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:11 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:11.238183 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4884fad2-2700-4524-bb26-2d1a08e55f74 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:11.239217 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4884fad2-2700-4524-bb26-2d1a08e55f74 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:11.245979 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4884fad2-2700-4524-bb26-2d1a08e55f74 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:11.246492 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4884fad2-2700-4524-bb26-2d1a08e55f74 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:11.247287 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4884fad2-2700-4524-bb26-2d1a08e55f74 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:11.247893 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4884fad2-2700-4524-bb26-2d1a08e55f74 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:11.264415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=100 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:11.286228 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6c31f13e-812b-4889-8f3d-b4bef3421b3f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:11.295476 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6c31f13e-812b-4889-8f3d-b4bef3421b3f tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1759 microversion: 2.1 time: 0.219299 May 19 13:58:11.296055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 274/539] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:11 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1759 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:11.301644 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-6b411ac8-52d3-4e52-95aa-bc4a4c344879 req-5da2fa2a-acbc-4eec-9eda-cc594d28ad57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282f0dfe-fd26-4a02-91e0-69716322d7d5", "tag": "e9f3edc9-7c52-4610-9122-024284dd285b"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:11.311396 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-6b411ac8-52d3-4e52-95aa-bc4a4c344879 req-5da2fa2a-acbc-4eec-9eda-cc594d28ad57 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:11.312128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-6b411ac8-52d3-4e52-95aa-bc4a4c344879 req-5da2fa2a-acbc-4eec-9eda-cc594d28ad57 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:11.314916 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:11.328740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-6b411ac8-52d3-4e52-95aa-bc4a4c344879 req-5da2fa2a-acbc-4eec-9eda-cc594d28ad57 service nova] Creating event network-changed:e9f3edc9-7c52-4610-9122-024284dd285b for instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 on hv-cinder-78481 May 19 13:58:11.335059 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-6b411ac8-52d3-4e52-95aa-bc4a4c344879 req-5da2fa2a-acbc-4eec-9eda-cc594d28ad57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036664 May 19 13:58:11.335660 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 275/540] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:11.393949 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4884fad2-2700-4524-bb26-2d1a08e55f74 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:11.403515 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4884fad2-2700-4524-bb26-2d1a08e55f74 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.170042 May 19 13:58:11.404086 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 266/541] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:11 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:12.081838 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9ee5bac3-cccb-4093-bbd4-61c29a882ae5 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:12.082521 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9ee5bac3-cccb-4093-bbd4-61c29a882ae5 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:12.089061 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9ee5bac3-cccb-4093-bbd4-61c29a882ae5 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:12.089506 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9ee5bac3-cccb-4093-bbd4-61c29a882ae5 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:12.090255 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9ee5bac3-cccb-4093-bbd4-61c29a882ae5 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:12.090686 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9ee5bac3-cccb-4093-bbd4-61c29a882ae5 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:12.226288 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9ee5bac3-cccb-4093-bbd4-61c29a882ae5 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:12.234903 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9ee5bac3-cccb-4093-bbd4-61c29a882ae5 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1259 microversion: 2.1 time: 0.157685 May 19 13:58:12.235629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 276/542] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:12 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:12.252170 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:12.252785 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:12.260405 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:12.260865 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:12.261615 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:12.262187 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:12.408770 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:12.417893 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:12.419377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:12.420528 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3bc14439-f942-409f-b12f-fd62dcbb2b75 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1807 microversion: 2.20 time: 0.172349 May 19 13:58:12.420763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-47b3c4d4-bedc-4570-a087-86bdee243d2f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:12.421244 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 267/543] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:12 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:12.421613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-47b3c4d4-bedc-4570-a087-86bdee243d2f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:12.429835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-47b3c4d4-bedc-4570-a087-86bdee243d2f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:12.430351 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-47b3c4d4-bedc-4570-a087-86bdee243d2f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:12.431226 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-47b3c4d4-bedc-4570-a087-86bdee243d2f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:12.431940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-47b3c4d4-bedc-4570-a087-86bdee243d2f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:12.570195 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-47b3c4d4-bedc-4570-a087-86bdee243d2f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:12.578443 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-47b3c4d4-bedc-4570-a087-86bdee243d2f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.162035 May 19 13:58:12.579081 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 277/544] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:12 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:13.251729 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c7b9f8d1-312e-40e9-bbf1-c7f6d727b31b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:13.252336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c7b9f8d1-312e-40e9-bbf1-c7f6d727b31b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:13.258632 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c7b9f8d1-312e-40e9-bbf1-c7f6d727b31b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:13.259055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c7b9f8d1-312e-40e9-bbf1-c7f6d727b31b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:13.259811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c7b9f8d1-312e-40e9-bbf1-c7f6d727b31b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:13.260237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c7b9f8d1-312e-40e9-bbf1-c7f6d727b31b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:13.393117 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c7b9f8d1-312e-40e9-bbf1-c7f6d727b31b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:13.401310 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c7b9f8d1-312e-40e9-bbf1-c7f6d727b31b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1259 microversion: 2.1 time: 0.153241 May 19 13:58:13.401665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 268/545] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:13 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:13.439842 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:13.440655 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:13.447065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:13.447539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:13.448296 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:13.448724 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:13.573786 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:13.582574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:13.584117 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:13.585417 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7bab34a9-d964-4460-9426-e873ce0c9999 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1794 microversion: 2.20 time: 0.149397 May 19 13:58:13.585969 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 278/546] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:13 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1794 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:58:13.595946 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5bbbdd3e-feb1-436f-9c9e-4590deffbd22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:13.596564 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5bbbdd3e-feb1-436f-9c9e-4590deffbd22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:13.603150 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5bbbdd3e-feb1-436f-9c9e-4590deffbd22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:13.603600 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5bbbdd3e-feb1-436f-9c9e-4590deffbd22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:13.604378 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5bbbdd3e-feb1-436f-9c9e-4590deffbd22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:13.604802 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5bbbdd3e-feb1-436f-9c9e-4590deffbd22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:13.729688 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5bbbdd3e-feb1-436f-9c9e-4590deffbd22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:13.737672 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5bbbdd3e-feb1-436f-9c9e-4590deffbd22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.145542 May 19 13:58:13.738409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 269/547] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:13 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:14.417559 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6308c313-143b-48bd-b488-382dcb4bafc3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:14.418176 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6308c313-143b-48bd-b488-382dcb4bafc3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:14.424253 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6308c313-143b-48bd-b488-382dcb4bafc3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:14.425221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6308c313-143b-48bd-b488-382dcb4bafc3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:14.425986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6308c313-143b-48bd-b488-382dcb4bafc3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:14.426423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6308c313-143b-48bd-b488-382dcb4bafc3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:14.557639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6308c313-143b-48bd-b488-382dcb4bafc3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:14.565122 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6308c313-143b-48bd-b488-382dcb4bafc3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1259 microversion: 2.1 time: 0.151484 May 19 13:58:14.566357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 279/548] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:14 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:14.755481 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-56383faa-33f2-4028-97e9-d4d767d072e0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:14.756098 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-56383faa-33f2-4028-97e9-d4d767d072e0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:14.762544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56383faa-33f2-4028-97e9-d4d767d072e0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:14.763035 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56383faa-33f2-4028-97e9-d4d767d072e0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:14.763803 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56383faa-33f2-4028-97e9-d4d767d072e0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:14.764242 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56383faa-33f2-4028-97e9-d4d767d072e0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:14.894151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-56383faa-33f2-4028-97e9-d4d767d072e0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:14.902716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-56383faa-33f2-4028-97e9-d4d767d072e0 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.151846 May 19 13:58:14.903369 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 270/549] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:14 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:15.583409 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-20360192-e215-4647-a142-00328ef2a9e7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:15.584027 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-20360192-e215-4647-a142-00328ef2a9e7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:15.590505 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-20360192-e215-4647-a142-00328ef2a9e7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:15.590995 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-20360192-e215-4647-a142-00328ef2a9e7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:15.591759 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-20360192-e215-4647-a142-00328ef2a9e7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:15.592200 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-20360192-e215-4647-a142-00328ef2a9e7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:15.727446 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-20360192-e215-4647-a142-00328ef2a9e7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:15.734763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-20360192-e215-4647-a142-00328ef2a9e7 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1259 microversion: 2.1 time: 0.155968 May 19 13:58:15.735412 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 280/550] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:15 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:15.920460 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7d389c64-df70-4c22-a887-8bcf52bfd7de tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:15.921064 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7d389c64-df70-4c22-a887-8bcf52bfd7de tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:15.928182 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d389c64-df70-4c22-a887-8bcf52bfd7de tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:15.928571 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d389c64-df70-4c22-a887-8bcf52bfd7de tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:15.929324 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d389c64-df70-4c22-a887-8bcf52bfd7de tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:15.929756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d389c64-df70-4c22-a887-8bcf52bfd7de tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:16.055342 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7d389c64-df70-4c22-a887-8bcf52bfd7de tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:16.063227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7d389c64-df70-4c22-a887-8bcf52bfd7de tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.146553 May 19 13:58:16.063790 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 271/551] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:15 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:16.263107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-611f2529-86bb-442f-bb78-750ec04df6ce req-db06be90-ae9f-44ae-9712-803be7761e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccab6e9-3133-4db9-a8d9-27c83353c00a", "name": "network-vif-plugged", "status": "completed", "tag": "80eac5d4-3a31-4ac5-b15f-b7109c704ba1"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:16.274178 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-611f2529-86bb-442f-bb78-750ec04df6ce req-db06be90-ae9f-44ae-9712-803be7761e4f service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:16.274727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-611f2529-86bb-442f-bb78-750ec04df6ce req-db06be90-ae9f-44ae-9712-803be7761e4f service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:16.286785 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-611f2529-86bb-442f-bb78-750ec04df6ce req-db06be90-ae9f-44ae-9712-803be7761e4f service nova] Creating event network-vif-plugged:80eac5d4-3a31-4ac5-b15f-b7109c704ba1 for instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a on hv-cinder-78481 May 19 13:58:16.292062 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-611f2529-86bb-442f-bb78-750ec04df6ce req-db06be90-ae9f-44ae-9712-803be7761e4f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033639 May 19 13:58:16.292663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 281/552] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:16.752099 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-45788303-dc82-4742-ac3f-0ffee0f1ce7c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:16.752631 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-45788303-dc82-4742-ac3f-0ffee0f1ce7c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:16.759335 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-45788303-dc82-4742-ac3f-0ffee0f1ce7c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:16.759780 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-45788303-dc82-4742-ac3f-0ffee0f1ce7c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:16.760538 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-45788303-dc82-4742-ac3f-0ffee0f1ce7c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:16.760973 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-45788303-dc82-4742-ac3f-0ffee0f1ce7c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:16.892568 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-45788303-dc82-4742-ac3f-0ffee0f1ce7c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:16.900040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-45788303-dc82-4742-ac3f-0ffee0f1ce7c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1259 microversion: 2.1 time: 0.151834 May 19 13:58:16.900603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 272/553] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:16 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:17.081058 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-476e249b-8687-428c-a84f-272eb811ab82 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:17.081674 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-476e249b-8687-428c-a84f-272eb811ab82 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:17.088430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-476e249b-8687-428c-a84f-272eb811ab82 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:17.088885 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-476e249b-8687-428c-a84f-272eb811ab82 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:17.089655 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-476e249b-8687-428c-a84f-272eb811ab82 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:17.090099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-476e249b-8687-428c-a84f-272eb811ab82 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:17.219454 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-476e249b-8687-428c-a84f-272eb811ab82 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:17.228326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-476e249b-8687-428c-a84f-272eb811ab82 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.151881 May 19 13:58:17.228892 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 282/554] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:17 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:17.917171 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-edd5a6d3-d40f-4907-a5d4-8c709dbb7f70 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:17.917803 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-edd5a6d3-d40f-4907-a5d4-8c709dbb7f70 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:17.924563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edd5a6d3-d40f-4907-a5d4-8c709dbb7f70 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:17.925004 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edd5a6d3-d40f-4907-a5d4-8c709dbb7f70 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:17.925883 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edd5a6d3-d40f-4907-a5d4-8c709dbb7f70 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:17.926399 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edd5a6d3-d40f-4907-a5d4-8c709dbb7f70 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:18.077434 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-edd5a6d3-d40f-4907-a5d4-8c709dbb7f70 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:18.085755 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-edd5a6d3-d40f-4907-a5d4-8c709dbb7f70 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1259 microversion: 2.1 time: 0.172393 May 19 13:58:18.086336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 273/555] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:17 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:18.246558 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-94dfbb8f-f0bb-443d-b7d7-5af5f7e1da22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:18.247284 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-94dfbb8f-f0bb-443d-b7d7-5af5f7e1da22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:18.254396 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-94dfbb8f-f0bb-443d-b7d7-5af5f7e1da22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:18.255152 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-94dfbb8f-f0bb-443d-b7d7-5af5f7e1da22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:18.255935 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-94dfbb8f-f0bb-443d-b7d7-5af5f7e1da22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:18.256374 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-94dfbb8f-f0bb-443d-b7d7-5af5f7e1da22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:18.611247 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-94dfbb8f-f0bb-443d-b7d7-5af5f7e1da22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:18.620016 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-94dfbb8f-f0bb-443d-b7d7-5af5f7e1da22 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.377582 May 19 13:58:18.620576 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 283/556] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:18 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:19.103297 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-865f174c-1d66-492a-bacb-dcb14b6e8ad1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:19.103944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-865f174c-1d66-492a-bacb-dcb14b6e8ad1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:19.110353 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-865f174c-1d66-492a-bacb-dcb14b6e8ad1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:19.110808 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-865f174c-1d66-492a-bacb-dcb14b6e8ad1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:19.111651 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-865f174c-1d66-492a-bacb-dcb14b6e8ad1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:19.112037 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-865f174c-1d66-492a-bacb-dcb14b6e8ad1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:19.239881 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-865f174c-1d66-492a-bacb-dcb14b6e8ad1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:19.247407 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-865f174c-1d66-492a-bacb-dcb14b6e8ad1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1444 microversion: 2.1 time: 0.148039 May 19 13:58:19.247977 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 274/557] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:19 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:19.264061 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3dda1e2a-769a-480b-8612-bbe027285d74 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:19.264667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3dda1e2a-769a-480b-8612-bbe027285d74 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:19.271407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3dda1e2a-769a-480b-8612-bbe027285d74 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:19.271865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3dda1e2a-769a-480b-8612-bbe027285d74 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:19.272642 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3dda1e2a-769a-480b-8612-bbe027285d74 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:19.273128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3dda1e2a-769a-480b-8612-bbe027285d74 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:19.409308 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3dda1e2a-769a-480b-8612-bbe027285d74 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:19.418271 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3dda1e2a-769a-480b-8612-bbe027285d74 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1444 microversion: 2.1 time: 0.157897 May 19 13:58:19.419067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 284/558] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:19 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:19.638916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e5809e63-132e-46f2-b1c7-441b59a4ff32 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:19.639551 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e5809e63-132e-46f2-b1c7-441b59a4ff32 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:19.646154 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5809e63-132e-46f2-b1c7-441b59a4ff32 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:19.646673 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5809e63-132e-46f2-b1c7-441b59a4ff32 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:19.647542 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5809e63-132e-46f2-b1c7-441b59a4ff32 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:19.648040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5809e63-132e-46f2-b1c7-441b59a4ff32 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:19.861737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e5809e63-132e-46f2-b1c7-441b59a4ff32 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:19.870820 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e5809e63-132e-46f2-b1c7-441b59a4ff32 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.236598 May 19 13:58:19.871432 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 275/559] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:19 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:20.888299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0dc55dbe-0ee3-4776-8969-5f4321c8eaf6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:20.888917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0dc55dbe-0ee3-4776-8969-5f4321c8eaf6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:20.896108 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0dc55dbe-0ee3-4776-8969-5f4321c8eaf6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:20.896566 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0dc55dbe-0ee3-4776-8969-5f4321c8eaf6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:20.897344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0dc55dbe-0ee3-4776-8969-5f4321c8eaf6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:20.897785 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0dc55dbe-0ee3-4776-8969-5f4321c8eaf6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:21.108287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-0dc55dbe-0ee3-4776-8969-5f4321c8eaf6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:21.116204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0dc55dbe-0ee3-4776-8969-5f4321c8eaf6 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.231877 May 19 13:58:21.116838 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 285/560] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:20 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:21.280321 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-3681ddb8-f6e6-41bf-ba9c-91e4aa8825c9 req-a40dd887-ae2d-493f-b901-6d8459ad3ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ccab6e9-3133-4db9-a8d9-27c83353c00a", "tag": "80eac5d4-3a31-4ac5-b15f-b7109c704ba1"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:21.289574 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-3681ddb8-f6e6-41bf-ba9c-91e4aa8825c9 req-a40dd887-ae2d-493f-b901-6d8459ad3ed7 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:21.290012 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-3681ddb8-f6e6-41bf-ba9c-91e4aa8825c9 req-a40dd887-ae2d-493f-b901-6d8459ad3ed7 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:21.301045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-3681ddb8-f6e6-41bf-ba9c-91e4aa8825c9 req-a40dd887-ae2d-493f-b901-6d8459ad3ed7 service nova] Creating event network-changed:80eac5d4-3a31-4ac5-b15f-b7109c704ba1 for instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a on hv-cinder-78481 May 19 13:58:21.306241 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-3681ddb8-f6e6-41bf-ba9c-91e4aa8825c9 req-a40dd887-ae2d-493f-b901-6d8459ad3ed7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030671 May 19 13:58:21.306920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 276/561] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:22.134051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f9e033fa-bb2c-4f26-b964-fdc9ffb36f26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:22.134724 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f9e033fa-bb2c-4f26-b964-fdc9ffb36f26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:22.143433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9e033fa-bb2c-4f26-b964-fdc9ffb36f26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:22.143855 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9e033fa-bb2c-4f26-b964-fdc9ffb36f26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:22.146887 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9e033fa-bb2c-4f26-b964-fdc9ffb36f26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:22.147345 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9e033fa-bb2c-4f26-b964-fdc9ffb36f26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:22.280053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f9e033fa-bb2c-4f26-b964-fdc9ffb36f26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:22.289423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f9e033fa-bb2c-4f26-b964-fdc9ffb36f26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.160553 May 19 13:58:22.289976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 286/562] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:22 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:23.308075 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-742e7731-3d14-4d7b-8fe9-836593a20bbf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:23.308766 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-742e7731-3d14-4d7b-8fe9-836593a20bbf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:23.314979 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-742e7731-3d14-4d7b-8fe9-836593a20bbf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:23.315427 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-742e7731-3d14-4d7b-8fe9-836593a20bbf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:23.316187 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-742e7731-3d14-4d7b-8fe9-836593a20bbf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:23.316624 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-742e7731-3d14-4d7b-8fe9-836593a20bbf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:23.447794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-742e7731-3d14-4d7b-8fe9-836593a20bbf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:23.455782 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-742e7731-3d14-4d7b-8fe9-836593a20bbf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.152409 May 19 13:58:23.456348 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 277/563] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:23 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:24.472144 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-209bc65a-4c41-4316-aaf9-61c124309246 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:24.472684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-209bc65a-4c41-4316-aaf9-61c124309246 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:24.479338 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-209bc65a-4c41-4316-aaf9-61c124309246 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:24.479794 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-209bc65a-4c41-4316-aaf9-61c124309246 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:24.480564 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-209bc65a-4c41-4316-aaf9-61c124309246 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:24.481012 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-209bc65a-4c41-4316-aaf9-61c124309246 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:24.606716 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-209bc65a-4c41-4316-aaf9-61c124309246 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:24.614935 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-209bc65a-4c41-4316-aaf9-61c124309246 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1733 microversion: 2.1 time: 0.146760 May 19 13:58:24.615504 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 287/564] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:24 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:25.075584 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-398ca5de-f404-4e27-a329-54b511192808 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:25.076139 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-398ca5de-f404-4e27-a329-54b511192808 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:25.082625 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-398ca5de-f404-4e27-a329-54b511192808 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.083210 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-398ca5de-f404-4e27-a329-54b511192808 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.083979 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-398ca5de-f404-4e27-a329-54b511192808 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.084418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-398ca5de-f404-4e27-a329-54b511192808 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.107168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-398ca5de-f404-4e27-a329-54b511192808 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4/ips" status: 200 len: 150 microversion: 2.1 time: 0.035352 May 19 13:58:25.107729 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 278/565] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 13:58:25 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:25.119140 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aebd848d-ae1f-4b07-b001-1c7d757b3491"}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:25.120219 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:25.126286 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.127102 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.128453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.129219 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.213540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Invalid volume: volume aebd848d-ae1f-4b07-b001-1c7d757b3491 is already attached to instances: 2e425ccc-4508-4267-bc69-5590c1f503ec May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: POST /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4/os-volume_attachments HTTP/1.1 May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 74 May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:58:25.215275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {"volumeAttachment": {"volumeId": "aebd848d-ae1f-4b07-b001-1c7d757b3491"}} May 19 13:58:25.216861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Invalid volume: volume aebd848d-ae1f-4b07-b001-1c7d757b3491 is already attached to instances: 2e425ccc-4508-4267-bc69-5590c1f503ec May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'server_id': '7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4', 'body': {'volumeAttachment': {'volumeId': 'aebd848d-ae1f-4b07-b001-1c7d757b3491'}}} May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aebd848d-ae1f-4b07-b001-1c7d757b3491 is already attached to instances: 2e425ccc-4508-4267-bc69-5590c1f503ec May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:25.217733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aebd848d-ae1f-4b07-b001-1c7d757b3491 is already attached to instances: 2e425ccc-4508-4267-bc69-5590c1f503ec May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:25.218931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:58:25.220103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:58:25.220103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:58:25.220103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:58:25.220103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aebd848d-ae1f-4b07-b001-1c7d757b3491 is already attached to instances: 2e425ccc-4508-4267-bc69-5590c1f503ec May 19 13:58:25.220103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:25.220103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 400 to user: Invalid volume: volume aebd848d-ae1f-4b07-b001-1c7d757b3491 is already attached to instances: 2e425ccc-4508-4267-bc69-5590c1f503ec {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:58:25.220103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2404072c-d7fd-4e01-b7c2-6e45277b4221 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102684 May 19 13:58:25.220103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 288/566] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 13:58:25 2022] POST /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 13:58:25.226025 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-459b140d-ff74-447b-90ee-f2fd59d025aa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:25.226520 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-459b140d-ff74-447b-90ee-f2fd59d025aa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:25.232641 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-459b140d-ff74-447b-90ee-f2fd59d025aa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.233090 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-459b140d-ff74-447b-90ee-f2fd59d025aa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.233845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-459b140d-ff74-447b-90ee-f2fd59d025aa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.234279 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-459b140d-ff74-447b-90ee-f2fd59d025aa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.259093 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-459b140d-ff74-447b-90ee-f2fd59d025aa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:58:25.335919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-459b140d-ff74-447b-90ee-f2fd59d025aa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 204 len: 0 microversion: 2.1 time: 0.113658 May 19 13:58:25.336511 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 279/567] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:58:25 2022] DELETE /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:58:25.344829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c522bed3-bc24-4184-a7d9-faeeb361e0dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:25.345447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c522bed3-bc24-4184-a7d9-faeeb361e0dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:25.354807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c522bed3-bc24-4184-a7d9-faeeb361e0dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.355287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c522bed3-bc24-4184-a7d9-faeeb361e0dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.356054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c522bed3-bc24-4184-a7d9-faeeb361e0dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.356491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c522bed3-bc24-4184-a7d9-faeeb361e0dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.486248 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c522bed3-bc24-4184-a7d9-faeeb361e0dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:25.495806 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c522bed3-bc24-4184-a7d9-faeeb361e0dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1681 microversion: 2.1 time: 0.154766 May 19 13:58:25.496739 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 289/568] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:25 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:25.633413 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a8414f77-7816-4a15-bd2a-55ea330ea8f3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:25.634109 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a8414f77-7816-4a15-bd2a-55ea330ea8f3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:25.640060 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a8414f77-7816-4a15-bd2a-55ea330ea8f3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.640514 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a8414f77-7816-4a15-bd2a-55ea330ea8f3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.641279 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a8414f77-7816-4a15-bd2a-55ea330ea8f3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.641721 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a8414f77-7816-4a15-bd2a-55ea330ea8f3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.770912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a8414f77-7816-4a15-bd2a-55ea330ea8f3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:25.779304 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a8414f77-7816-4a15-bd2a-55ea330ea8f3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1713 microversion: 2.1 time: 0.150979 May 19 13:58:25.779873 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 280/569] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:25 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1713 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:25.881481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:25.881967 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:25.887896 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.888372 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:25.889134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:25.889569 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:26.013673 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] HTTP exception thrown: Cannot 'detach_volume' instance 83247503-3bc5-4f4d-9221-acd8b14033e8 while it is in vm_state rescued May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Request method failure captured: May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments/71643f73-657e-40a8-b0ec-d984e6565363 HTTP/1.1 May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwR8hzgIQIvgXeEM5L2dMhVxvBFzRTgSVN6ic_FVvk5L-iPskc47LcpgVydeVUCvM0x7XfiA91dw9McFpEV16_PqPrAs7WDyu_9PxCp_2nJTUBv4popy6qF1P2_PDF8M1xIqMvUfN4G_EW0aX6yCiNb6CHv7jCtLFHzhW1M2f-GVSU May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:58:26.015203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}] May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 698ccea06fb24beea18c679d53f907a6 May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:58:26.016681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Cannot 'detach_volume' instance 83247503-3bc5-4f4d-9221-acd8b14033e8 while it is in vm_state rescued May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'server_id': '83247503-3bc5-4f4d-9221-acd8b14033e8', 'id': '71643f73-657e-40a8-b0ec-d984e6565363'} May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 83247503-3bc5-4f4d-9221-acd8b14033e8 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:58:26.017438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 83247503-3bc5-4f4d-9221-acd8b14033e8 while it is in vm_state rescued May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 83247503-3bc5-4f4d-9221-acd8b14033e8 while it is in vm_state rescued May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:26.018552 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Returning 409 to user: Cannot 'detach_volume' instance 83247503-3bc5-4f4d-9221-acd8b14033e8 while it is in vm_state rescued {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:58:26.019499 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8f6bab6d-78b0-4a88-b3d8-f933d6e6ecc3 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "DELETE /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments/71643f73-657e-40a8-b0ec-d984e6565363" status: 409 len: 152 microversion: 2.1 time: 0.139373 May 19 13:58:26.019499 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 290/570] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 13:58:25 2022] DELETE /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments/71643f73-657e-40a8-b0ec-d984e6565363 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 13:58:26.026117 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-77316230-e4fe-4856-b99c-7aac416c1c26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:26.026691 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-77316230-e4fe-4856-b99c-7aac416c1c26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:26.032920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-77316230-e4fe-4856-b99c-7aac416c1c26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:26.033370 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-77316230-e4fe-4856-b99c-7aac416c1c26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:26.034134 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-77316230-e4fe-4856-b99c-7aac416c1c26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:26.034572 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-77316230-e4fe-4856-b99c-7aac416c1c26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:26.078173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:26.099665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-77316230-e4fe-4856-b99c-7aac416c1c26 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "POST /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/action" status: 202 len: 0 microversion: 2.1 time: 0.077210 May 19 13:58:26.100272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 281/571] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 13:58:26 2022] POST /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:58:26.108237 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b20e8662-4e4e-46ec-82bd-260d45014918 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:26.109456 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b20e8662-4e4e-46ec-82bd-260d45014918 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:26.115486 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b20e8662-4e4e-46ec-82bd-260d45014918 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:26.115933 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b20e8662-4e4e-46ec-82bd-260d45014918 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:26.116690 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b20e8662-4e4e-46ec-82bd-260d45014918 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:26.117124 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b20e8662-4e4e-46ec-82bd-260d45014918 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:26.246087 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b20e8662-4e4e-46ec-82bd-260d45014918 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:26.253938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b20e8662-4e4e-46ec-82bd-260d45014918 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1721 microversion: 2.1 time: 0.149505 May 19 13:58:26.254560 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 291/572] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:26 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:26.515806 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a0eaeee6-f3db-49a9-be96-ac39fcbfb551 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:26.516425 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a0eaeee6-f3db-49a9-be96-ac39fcbfb551 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:26.523339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0eaeee6-f3db-49a9-be96-ac39fcbfb551 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:26.523792 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0eaeee6-f3db-49a9-be96-ac39fcbfb551 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:26.524554 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0eaeee6-f3db-49a9-be96-ac39fcbfb551 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:26.524990 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0eaeee6-f3db-49a9-be96-ac39fcbfb551 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:26.654978 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a0eaeee6-f3db-49a9-be96-ac39fcbfb551 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:26.663206 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a0eaeee6-f3db-49a9-be96-ac39fcbfb551 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1681 microversion: 2.1 time: 0.151703 May 19 13:58:26.663790 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 282/573] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:26 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:27.271590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4685d00d-e1ef-4690-8c78-9e8c482ef391 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:27.272207 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4685d00d-e1ef-4690-8c78-9e8c482ef391 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:27.278686 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4685d00d-e1ef-4690-8c78-9e8c482ef391 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:27.279181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4685d00d-e1ef-4690-8c78-9e8c482ef391 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:27.279952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4685d00d-e1ef-4690-8c78-9e8c482ef391 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:27.280392 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4685d00d-e1ef-4690-8c78-9e8c482ef391 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:27.407839 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4685d00d-e1ef-4690-8c78-9e8c482ef391 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:27.416567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4685d00d-e1ef-4690-8c78-9e8c482ef391 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1721 microversion: 2.1 time: 0.149009 May 19 13:58:27.417142 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 292/574] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:27 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:27.681243 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6dcb59dd-4994-4362-964a-b741be70dde5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:27.682054 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6dcb59dd-4994-4362-964a-b741be70dde5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:27.688651 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6dcb59dd-4994-4362-964a-b741be70dde5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:27.689105 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6dcb59dd-4994-4362-964a-b741be70dde5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:27.689868 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6dcb59dd-4994-4362-964a-b741be70dde5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:27.690360 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6dcb59dd-4994-4362-964a-b741be70dde5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:27.967050 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6dcb59dd-4994-4362-964a-b741be70dde5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:27.974693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6dcb59dd-4994-4362-964a-b741be70dde5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1681 microversion: 2.1 time: 0.297341 May 19 13:58:27.975418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 283/575] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:27 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1681 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:28.433761 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-dcd2e441-f9c9-4314-9c96-32460cc28b38 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:28.434383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-dcd2e441-f9c9-4314-9c96-32460cc28b38 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:28.441824 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dcd2e441-f9c9-4314-9c96-32460cc28b38 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:28.442391 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dcd2e441-f9c9-4314-9c96-32460cc28b38 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:28.443210 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dcd2e441-f9c9-4314-9c96-32460cc28b38 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:28.443644 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dcd2e441-f9c9-4314-9c96-32460cc28b38 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:28.446621 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:28.693198 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-dcd2e441-f9c9-4314-9c96-32460cc28b38 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:28.702100 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-dcd2e441-f9c9-4314-9c96-32460cc28b38 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1721 microversion: 2.1 time: 0.272127 May 19 13:58:28.702951 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 293/576] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:28 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1721 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:28.726453 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-65df7de1-2ca0-4425-b0df-940dbca5ed2a req-2df6c3c7-ef7f-4f1d-a187-9e2ef44e2c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4", "name": "network-vif-deleted", "tag": "c02446b0-9eb0-4b0a-a1be-d0bf663a7a3d"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:28.735480 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-65df7de1-2ca0-4425-b0df-940dbca5ed2a req-2df6c3c7-ef7f-4f1d-a187-9e2ef44e2c6a service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:28.735919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-65df7de1-2ca0-4425-b0df-940dbca5ed2a req-2df6c3c7-ef7f-4f1d-a187-9e2ef44e2c6a service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:28.748099 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-65df7de1-2ca0-4425-b0df-940dbca5ed2a req-2df6c3c7-ef7f-4f1d-a187-9e2ef44e2c6a service nova] Creating event network-vif-deleted:c02446b0-9eb0-4b0a-a1be-d0bf663a7a3d for instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 on hv-cinder-78481 May 19 13:58:28.752980 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-65df7de1-2ca0-4425-b0df-940dbca5ed2a req-2df6c3c7-ef7f-4f1d-a187-9e2ef44e2c6a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031113 May 19 13:58:28.753715 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 284/577] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:28.992210 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4353f0ad-abbd-4e81-85cc-5b018c35f21b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:28.992864 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4353f0ad-abbd-4e81-85cc-5b018c35f21b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:28.999122 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4353f0ad-abbd-4e81-85cc-5b018c35f21b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:28.999576 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4353f0ad-abbd-4e81-85cc-5b018c35f21b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:29.000763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4353f0ad-abbd-4e81-85cc-5b018c35f21b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:29.000763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4353f0ad-abbd-4e81-85cc-5b018c35f21b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:29.070257 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4353f0ad-abbd-4e81-85cc-5b018c35f21b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:29.078175 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4353f0ad-abbd-4e81-85cc-5b018c35f21b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1615 microversion: 2.1 time: 0.090303 May 19 13:58:29.078950 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 294/578] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:28 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1615 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:29.720087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b0f4d729-0841-43c8-b0c8-c06aafd2a07b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:29.720811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b0f4d729-0841-43c8-b0c8-c06aafd2a07b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:29.722775 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:29.741377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b0f4d729-0841-43c8-b0c8-c06aafd2a07b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:29.742034 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b0f4d729-0841-43c8-b0c8-c06aafd2a07b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:29.742788 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b0f4d729-0841-43c8-b0c8-c06aafd2a07b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:29.743385 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b0f4d729-0841-43c8-b0c8-c06aafd2a07b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:29.888890 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b0f4d729-0841-43c8-b0c8-c06aafd2a07b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:29.899572 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b0f4d729-0841-43c8-b0c8-c06aafd2a07b tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1721 microversion: 2.1 time: 0.183411 May 19 13:58:29.900386 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 285/579] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:29 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:30.096074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:30.096642 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:30.104143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:30.104592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:30.105510 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:30.106121 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:30.137037 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:30.137483 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:30.137925 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lazy-loading 'fault' on Instance uuid 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:58:30.184249 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:30.192302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d048044b-5550-4eea-bdf7-a26224da5463 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 200 len: 1332 microversion: 2.1 time: 0.100257 May 19 13:58:30.192904 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 295/580] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:30 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:30.916467 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-05f8d1a0-204c-4b06-a50b-c801a64b79be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:30.917196 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-05f8d1a0-204c-4b06-a50b-c801a64b79be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:30.925590 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-05f8d1a0-204c-4b06-a50b-c801a64b79be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:30.926685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-05f8d1a0-204c-4b06-a50b-c801a64b79be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:30.927576 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-05f8d1a0-204c-4b06-a50b-c801a64b79be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:30.928099 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-05f8d1a0-204c-4b06-a50b-c801a64b79be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:31.070926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-05f8d1a0-204c-4b06-a50b-c801a64b79be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:31.079227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-05f8d1a0-204c-4b06-a50b-c801a64b79be tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1727 microversion: 2.1 time: 0.166634 May 19 13:58:31.079806 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 286/581] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:30 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:31.096577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d5f1567d-8fdd-4d88-aa4b-83fa70bd8faf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:31.097177 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d5f1567d-8fdd-4d88-aa4b-83fa70bd8faf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:31.103514 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5f1567d-8fdd-4d88-aa4b-83fa70bd8faf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:31.103963 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5f1567d-8fdd-4d88-aa4b-83fa70bd8faf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:31.104756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5f1567d-8fdd-4d88-aa4b-83fa70bd8faf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:31.105197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5f1567d-8fdd-4d88-aa4b-83fa70bd8faf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:31.181009 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d5f1567d-8fdd-4d88-aa4b-83fa70bd8faf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088262 May 19 13:58:31.181673 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 296/582] 10.222.0.52 () {58 vars in 1274 bytes} [Thu May 19 13:58:31 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:58:31.210050 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:31.210830 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:31.216840 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:31.217405 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:31.218259 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:31.218787 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:31.234108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 HTTP/1.1 May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:58:31.236933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 13:58:31.238537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4'} May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:58:31.239543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 13:58:31.240992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:58:31.242801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:58:31.242801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-16776f83-d586-4170-87c0-99389124b096 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 404 len: 111 microversion: 2.1 time: 0.034008 May 19 13:58:31.242801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 287/583] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:31 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:58:31.249470 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bb3a7d4a-cac7-4a65-b030-1be88896d900 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '.version_select at 0x7f5de23f3b80>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:31.269402 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bb3a7d4a-cac7-4a65-b030-1be88896d900 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023164970" status: 202 len: 0 microversion: 2.1 time: 0.023631 May 19 13:58:31.270547 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 297/584] 10.222.0.52 () {58 vars in 1220 bytes} [Thu May 19 13:58:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023164970 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 13:58:32.347532 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3e70f8dd-9c9b-43ba-aeb3-d1a5635e98dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:32.348621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3e70f8dd-9c9b-43ba-aeb3-d1a5635e98dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:32.355117 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e70f8dd-9c9b-43ba-aeb3-d1a5635e98dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:32.355545 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e70f8dd-9c9b-43ba-aeb3-d1a5635e98dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:32.356301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e70f8dd-9c9b-43ba-aeb3-d1a5635e98dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:32.356731 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e70f8dd-9c9b-43ba-aeb3-d1a5635e98dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:32.440815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-3f21699e-82bb-44f9-9c91-8b9f1e8310d9 req-2079364f-4b1a-4f9f-87aa-3d6e2bf2efda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83247503-3bc5-4f4d-9221-acd8b14033e8", "tag": "9636a338-81c2-4e01-8620-ce36ba238295"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:32.451938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-3f21699e-82bb-44f9-9c91-8b9f1e8310d9 req-2079364f-4b1a-4f9f-87aa-3d6e2bf2efda service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:32.452691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-3f21699e-82bb-44f9-9c91-8b9f1e8310d9 req-2079364f-4b1a-4f9f-87aa-3d6e2bf2efda service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:32.465830 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-3f21699e-82bb-44f9-9c91-8b9f1e8310d9 req-2079364f-4b1a-4f9f-87aa-3d6e2bf2efda service nova] Creating event network-changed:9636a338-81c2-4e01-8620-ce36ba238295 for instance 83247503-3bc5-4f4d-9221-acd8b14033e8 on hv-cinder-78481 May 19 13:58:32.472689 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-3f21699e-82bb-44f9-9c91-8b9f1e8310d9 req-2079364f-4b1a-4f9f-87aa-3d6e2bf2efda service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034887 May 19 13:58:32.475123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 298/585] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:58:32.495809 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-3e70f8dd-9c9b-43ba-aeb3-d1a5635e98dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lazy-loading 'services' on Instance uuid 2e425ccc-4508-4267-bc69-5590c1f503ec {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:58:32.766912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3e70f8dd-9c9b-43ba-aeb3-d1a5635e98dd tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments/aebd848d-ae1f-4b07-b001-1c7d757b3491" status: 202 len: 0 microversion: 2.1 time: 0.423098 May 19 13:58:32.767526 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 288/586] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 13:58:32 2022] DELETE /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments/aebd848d-ae1f-4b07-b001-1c7d757b3491 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:58:32.776750 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b68ed54b-4b15-4861-8793-498d77185eb4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:32.777777 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b68ed54b-4b15-4861-8793-498d77185eb4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:32.784152 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b68ed54b-4b15-4861-8793-498d77185eb4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:32.784520 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b68ed54b-4b15-4861-8793-498d77185eb4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:32.785562 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b68ed54b-4b15-4861-8793-498d77185eb4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:32.786162 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b68ed54b-4b15-4861-8793-498d77185eb4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:32.818467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b68ed54b-4b15-4861-8793-498d77185eb4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045935 May 19 13:58:32.819060 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 299/587] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:58:32 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:33.831193 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3e615ba2-7693-4640-bc9b-d1b13bc579ab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:33.832544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3e615ba2-7693-4640-bc9b-d1b13bc579ab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:33.839383 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e615ba2-7693-4640-bc9b-d1b13bc579ab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:33.839828 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e615ba2-7693-4640-bc9b-d1b13bc579ab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:33.840583 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e615ba2-7693-4640-bc9b-d1b13bc579ab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:33.841009 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e615ba2-7693-4640-bc9b-d1b13bc579ab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:33.869971 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3e615ba2-7693-4640-bc9b-d1b13bc579ab tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043548 May 19 13:58:33.870576 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 289/588] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:58:33 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:58:34.489231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-dce0f6c3-7427-4b34-b6b1-141929c95d2e req-5495219b-f2b4-4221-8ce7-e6da95730585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83247503-3bc5-4f4d-9221-acd8b14033e8", "tag": "9636a338-81c2-4e01-8620-ce36ba238295"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:34.493309 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:34.499501 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-dce0f6c3-7427-4b34-b6b1-141929c95d2e req-5495219b-f2b4-4221-8ce7-e6da95730585 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:34.499949 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-dce0f6c3-7427-4b34-b6b1-141929c95d2e req-5495219b-f2b4-4221-8ce7-e6da95730585 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:34.512384 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-dce0f6c3-7427-4b34-b6b1-141929c95d2e req-5495219b-f2b4-4221-8ce7-e6da95730585 service nova] Creating event network-changed:9636a338-81c2-4e01-8620-ce36ba238295 for instance 83247503-3bc5-4f4d-9221-acd8b14033e8 on hv-cinder-78481 May 19 13:58:34.517062 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-dce0f6c3-7427-4b34-b6b1-141929c95d2e req-5495219b-f2b4-4221-8ce7-e6da95730585 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032040 May 19 13:58:34.517637 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 300/589] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:34.881561 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-af93f35d-6f84-4f6d-99b1-e932410c136e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:34.882465 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-af93f35d-6f84-4f6d-99b1-e932410c136e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:34.888835 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af93f35d-6f84-4f6d-99b1-e932410c136e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:34.889279 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af93f35d-6f84-4f6d-99b1-e932410c136e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:34.890032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af93f35d-6f84-4f6d-99b1-e932410c136e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:34.890466 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af93f35d-6f84-4f6d-99b1-e932410c136e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:34.919292 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-af93f35d-6f84-4f6d-99b1-e932410c136e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042028 May 19 13:58:34.919845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 290/590] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:58:34 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:58:34.938293 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4928f072-46fd-42dd-b616-7d860cbbfc02 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:34.939370 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4928f072-46fd-42dd-b616-7d860cbbfc02 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:34.945751 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4928f072-46fd-42dd-b616-7d860cbbfc02 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:34.946210 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4928f072-46fd-42dd-b616-7d860cbbfc02 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:34.947019 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4928f072-46fd-42dd-b616-7d860cbbfc02 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:34.947467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4928f072-46fd-42dd-b616-7d860cbbfc02 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:34.981004 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-681df45d-a557-4b16-a666-11e193c047b4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:34.981497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-681df45d-a557-4b16-a666-11e193c047b4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:34.987491 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-681df45d-a557-4b16-a666-11e193c047b4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:34.987994 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-681df45d-a557-4b16-a666-11e193c047b4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:34.989398 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-681df45d-a557-4b16-a666-11e193c047b4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:34.989838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-681df45d-a557-4b16-a666-11e193c047b4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:35.018236 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-681df45d-a557-4b16-a666-11e193c047b4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:58:35.023470 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4928f072-46fd-42dd-b616-7d860cbbfc02 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "POST /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.089199 May 19 13:58:35.024313 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 301/591] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 13:58:34 2022] POST /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:58:35.033644 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-493ebf16-3308-41ca-86b3-7c44cc53eda1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:35.034698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-493ebf16-3308-41ca-86b3-7c44cc53eda1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:35.044556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-493ebf16-3308-41ca-86b3-7c44cc53eda1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:35.045595 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-493ebf16-3308-41ca-86b3-7c44cc53eda1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:35.046326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-493ebf16-3308-41ca-86b3-7c44cc53eda1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:35.046890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-493ebf16-3308-41ca-86b3-7c44cc53eda1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:35.107941 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-681df45d-a557-4b16-a666-11e193c047b4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 204 len: 0 microversion: 2.1 time: 0.127824 May 19 13:58:35.108697 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 291/592] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:58:34 2022] DELETE /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 13:58:35.117949 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-51d1848e-7329-4fc3-a65b-b05e8e192069 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:35.118649 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-51d1848e-7329-4fc3-a65b-b05e8e192069 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:35.124657 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-51d1848e-7329-4fc3-a65b-b05e8e192069 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:35.125216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-51d1848e-7329-4fc3-a65b-b05e8e192069 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:35.125985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-51d1848e-7329-4fc3-a65b-b05e8e192069 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:35.126421 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-51d1848e-7329-4fc3-a65b-b05e8e192069 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:35.269317 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-493ebf16-3308-41ca-86b3-7c44cc53eda1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:35.277465 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-493ebf16-3308-41ca-86b3-7c44cc53eda1 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1751 microversion: 2.1 time: 0.248761 May 19 13:58:35.278231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 302/593] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:35 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1751 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:35.298144 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-51d1848e-7329-4fc3-a65b-b05e8e192069 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:35.306313 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-51d1848e-7329-4fc3-a65b-b05e8e192069 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1681 microversion: 2.1 time: 0.193302 May 19 13:58:35.306884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 292/594] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:35 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1681 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:36.295305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c60d4df5-8e0a-4dc1-a071-7ac1a792a2fe tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:36.295836 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c60d4df5-8e0a-4dc1-a071-7ac1a792a2fe tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:36.304103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c60d4df5-8e0a-4dc1-a071-7ac1a792a2fe tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:36.304925 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c60d4df5-8e0a-4dc1-a071-7ac1a792a2fe tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:36.305738 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c60d4df5-8e0a-4dc1-a071-7ac1a792a2fe tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:36.306177 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c60d4df5-8e0a-4dc1-a071-7ac1a792a2fe tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:36.324591 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0c27db72-5700-4bc5-a4d1-4e749473d030 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:36.325215 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0c27db72-5700-4bc5-a4d1-4e749473d030 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:36.331944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0c27db72-5700-4bc5-a4d1-4e749473d030 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:36.332428 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0c27db72-5700-4bc5-a4d1-4e749473d030 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:36.333288 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0c27db72-5700-4bc5-a4d1-4e749473d030 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:36.333729 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0c27db72-5700-4bc5-a4d1-4e749473d030 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:36.523041 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0c27db72-5700-4bc5-a4d1-4e749473d030 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:36.528156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c60d4df5-8e0a-4dc1-a071-7ac1a792a2fe tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:36.530740 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0c27db72-5700-4bc5-a4d1-4e749473d030 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1681 microversion: 2.1 time: 0.210276 May 19 13:58:36.531555 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 293/595] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:36 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1681 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:36.539745 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c60d4df5-8e0a-4dc1-a071-7ac1a792a2fe tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1751 microversion: 2.1 time: 0.248421 May 19 13:58:36.540392 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 303/596] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:36 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1751 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:37.551703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2732d15a-31b1-4fcd-a191-49d46b9f2c91 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:37.552380 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2732d15a-31b1-4fcd-a191-49d46b9f2c91 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:37.558152 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-75813984-c167-42b1-ab2b-481142916649 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:37.559038 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2732d15a-31b1-4fcd-a191-49d46b9f2c91 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:37.559496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2732d15a-31b1-4fcd-a191-49d46b9f2c91 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:37.559938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-75813984-c167-42b1-ab2b-481142916649 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:37.560320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2732d15a-31b1-4fcd-a191-49d46b9f2c91 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:37.560760 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2732d15a-31b1-4fcd-a191-49d46b9f2c91 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:37.568601 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-75813984-c167-42b1-ab2b-481142916649 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:37.569340 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-75813984-c167-42b1-ab2b-481142916649 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:37.571042 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-75813984-c167-42b1-ab2b-481142916649 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:37.571888 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-75813984-c167-42b1-ab2b-481142916649 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:37.766045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2732d15a-31b1-4fcd-a191-49d46b9f2c91 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:37.776310 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2732d15a-31b1-4fcd-a191-49d46b9f2c91 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1681 microversion: 2.1 time: 0.230511 May 19 13:58:37.777598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 294/597] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:37 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:37.798730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-75813984-c167-42b1-ab2b-481142916649 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:37.807940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-75813984-c167-42b1-ab2b-481142916649 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.254311 May 19 13:58:37.808513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 304/598] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:37 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:38.334707 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-2874cba9-cc53-4f68-a885-1e18d89c620e req-68a2151f-4e6a-43ec-8a7e-7b9fa7c550ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e425ccc-4508-4267-bc69-5590c1f503ec", "name": "network-vif-deleted", "tag": "a4da582a-6527-48e4-b52c-7d888d7e053a"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:38.343871 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-2874cba9-cc53-4f68-a885-1e18d89c620e req-68a2151f-4e6a-43ec-8a7e-7b9fa7c550ab service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:38.344314 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-2874cba9-cc53-4f68-a885-1e18d89c620e req-68a2151f-4e6a-43ec-8a7e-7b9fa7c550ab service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:38.355997 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-2874cba9-cc53-4f68-a885-1e18d89c620e req-68a2151f-4e6a-43ec-8a7e-7b9fa7c550ab service nova] Creating event network-vif-deleted:a4da582a-6527-48e4-b52c-7d888d7e053a for instance 2e425ccc-4508-4267-bc69-5590c1f503ec on hv-cinder-78481 May 19 13:58:38.361407 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-2874cba9-cc53-4f68-a885-1e18d89c620e req-68a2151f-4e6a-43ec-8a7e-7b9fa7c550ab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030331 May 19 13:58:38.362643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 295/599] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:38.794918 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:38.795486 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:38.802079 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:38.802532 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:38.803338 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:38.803776 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:38.828824 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6fd55a16-bffd-4b6b-8625-46f16fa290f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:38.830238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6fd55a16-bffd-4b6b-8625-46f16fa290f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:38.837079 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:38.837780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:38.838394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lazy-loading 'fault' on Instance uuid 2e425ccc-4508-4267-bc69-5590c1f503ec {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:58:38.838970 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fd55a16-bffd-4b6b-8625-46f16fa290f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:38.839427 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fd55a16-bffd-4b6b-8625-46f16fa290f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:38.840301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fd55a16-bffd-4b6b-8625-46f16fa290f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:38.840774 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fd55a16-bffd-4b6b-8625-46f16fa290f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:38.913402 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:38.921735 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-07bb4b83-495a-4819-a7ad-d83ad72d4a80 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 200 len: 1331 microversion: 2.1 time: 0.130827 May 19 13:58:38.923473 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 305/600] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:38 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:39.033858 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6fd55a16-bffd-4b6b-8625-46f16fa290f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:39.043173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6fd55a16-bffd-4b6b-8625-46f16fa290f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.220528 May 19 13:58:39.043850 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 296/601] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:38 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:39.940835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:39.942085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:39.948838 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:39.949288 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:39.950038 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:39.950468 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:39.963393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec HTTP/1.1 May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:58:39.965001 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 13:58:39.966447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '2e425ccc-4508-4267-bc69-5590c1f503ec'} May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:58:39.967341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 13:58:39.968708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:58:39.970285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:58:39.970285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-fbf25b08-7f6e-4097-b2ae-2c0a92f70aaa tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 404 len: 111 microversion: 2.1 time: 0.029430 May 19 13:58:39.970285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 306/602] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:39 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:58:39.974851 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8e8aabba-22eb-47cb-ab26-0ec0154d532c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '.version_select at 0x7f5de1d38ca0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:39.993756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8e8aabba-22eb-47cb-ab26-0ec0154d532c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-400520829" status: 202 len: 0 microversion: 2.1 time: 0.022574 May 19 13:58:39.994309 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 297/603] 10.222.0.52 () {58 vars in 1217 bytes} [Thu May 19 13:58:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-400520829 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:58:40.060970 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-53cd8a6b-1506-467a-8c38-8329963e21d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:40.061585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-53cd8a6b-1506-467a-8c38-8329963e21d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:40.068443 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-53cd8a6b-1506-467a-8c38-8329963e21d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:40.068891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-53cd8a6b-1506-467a-8c38-8329963e21d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:40.069684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-53cd8a6b-1506-467a-8c38-8329963e21d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:40.070118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-53cd8a6b-1506-467a-8c38-8329963e21d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:40.220684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-53cd8a6b-1506-467a-8c38-8329963e21d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:40.229300 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-53cd8a6b-1506-467a-8c38-8329963e21d2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.172096 May 19 13:58:40.229863 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 307/604] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:40 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:40.624523 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0c3908d5-6973-4bd1-9071-b2166933f28a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: .version_select at 0x7f5de1d73430>, body: {"keypair": {"name": "tempest-keypair-1550151094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6RY+j6RfUsSCO64fh9xapjREKKxaMcdVhrB5xWKmk1hbpZdrpMpN5iB0kZW7g+4F/bO/WYqRyaW07T3zLBMW8Z+Gq30CsijJ/lGS6G+6UVyoq9clSg9e5lqjXq244qXA=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:40.638947 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-0c3908d5-6973-4bd1-9071-b2166933f28a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for project 89b4336043d5446b922432a2f43af17a. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:58:40.642638 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-0c3908d5-6973-4bd1-9071-b2166933f28a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for user 0cc3e0105f2a472092423852b1f39979 and project 89b4336043d5446b922432a2f43af17a. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:58:40.664368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0c3908d5-6973-4bd1-9071-b2166933f28a tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043707 May 19 13:58:40.664952 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 298/605] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 13:58:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:41.247540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b962b455-5511-468d-a63a-19a118b39fb2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:41.248180 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b962b455-5511-468d-a63a-19a118b39fb2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:41.255856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b962b455-5511-468d-a63a-19a118b39fb2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:41.256305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b962b455-5511-468d-a63a-19a118b39fb2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:41.257123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b962b455-5511-468d-a63a-19a118b39fb2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:41.257569 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b962b455-5511-468d-a63a-19a118b39fb2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:41.456870 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b962b455-5511-468d-a63a-19a118b39fb2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:41.465075 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b962b455-5511-468d-a63a-19a118b39fb2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.221367 May 19 13:58:41.465649 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 308/606] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:41 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:42.024674 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1898318621", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08206db8-8e78-4412-8a62-0db97bb617cf"}], "security_groups": [{"name": "tempest-securitygroup--2053240073"}], "key_name": "tempest-keypair-1550151094", "user_data": "}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:42.124484 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] validate_networks() for [('08206db8-8e78-4412-8a62-0db97bb617cf', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:58:42.483646 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-182cc0c9-041f-49d8-b78e-1567b9065e29 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:42.484094 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-182cc0c9-041f-49d8-b78e-1567b9065e29 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:42.485870 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:58:42.486360 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:58:42.487266 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:58:42.487396 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:58:42.487882 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:58:42.491205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-182cc0c9-041f-49d8-b78e-1567b9065e29 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:42.491664 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-182cc0c9-041f-49d8-b78e-1567b9065e29 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:42.492432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-182cc0c9-041f-49d8-b78e-1567b9065e29 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:42.492871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-182cc0c9-041f-49d8-b78e-1567b9065e29 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:42.497917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:42.498364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:42.499205 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:42.499643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:42.516441 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for project 89b4336043d5446b922432a2f43af17a. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:58:42.520492 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for user 0cc3e0105f2a472092423852b1f39979 and project 89b4336043d5446b922432a2f43af17a. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:58:42.532131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:58:42.534398 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:58:42.584771 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d15816a1-0691-491f-bd82-cef5699674c4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564784 May 19 13:58:42.585590 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 299/607] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:58:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:58:42.596079 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e70ee784-2026-4078-a9c7-0899433a7fc3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:42.597032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e70ee784-2026-4078-a9c7-0899433a7fc3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:42.665782 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e70ee784-2026-4078-a9c7-0899433a7fc3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:42.671736 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-182cc0c9-041f-49d8-b78e-1567b9065e29 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:42.672656 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e70ee784-2026-4078-a9c7-0899433a7fc3 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1242 microversion: 2.1 time: 0.080796 May 19 13:58:42.673218 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 300/608] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:42 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:42.683196 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-182cc0c9-041f-49d8-b78e-1567b9065e29 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.203486 May 19 13:58:42.683757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 309/609] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:42 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:43.690659 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d8c3c2d3-973e-43d2-8c4d-bd71f5ff9750 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:43.691351 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d8c3c2d3-973e-43d2-8c4d-bd71f5ff9750 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:43.700650 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0a0b5bb6-f243-4549-9550-8b0799372360 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:43.702282 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0a0b5bb6-f243-4549-9550-8b0799372360 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:43.703386 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8c3c2d3-973e-43d2-8c4d-bd71f5ff9750 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:43.703842 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8c3c2d3-973e-43d2-8c4d-bd71f5ff9750 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:43.704674 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8c3c2d3-973e-43d2-8c4d-bd71f5ff9750 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:43.705120 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8c3c2d3-973e-43d2-8c4d-bd71f5ff9750 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:43.712304 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0a0b5bb6-f243-4549-9550-8b0799372360 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:43.713015 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0a0b5bb6-f243-4549-9550-8b0799372360 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:43.713962 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0a0b5bb6-f243-4549-9550-8b0799372360 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:43.714566 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0a0b5bb6-f243-4549-9550-8b0799372360 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:43.731035 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:43.786048 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d8c3c2d3-973e-43d2-8c4d-bd71f5ff9750 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:43.799101 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d8c3c2d3-973e-43d2-8c4d-bd71f5ff9750 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1302 microversion: 2.1 time: 0.112537 May 19 13:58:43.799767 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 301/610] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:43 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1302 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:43.891570 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-0a0b5bb6-f243-4549-9550-8b0799372360 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:43.900688 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0a0b5bb6-f243-4549-9550-8b0799372360 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.203692 May 19 13:58:43.901266 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 310/611] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:43 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:44.816652 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-52949657-450c-4052-bf2b-103614f8cd28 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:44.817272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-52949657-450c-4052-bf2b-103614f8cd28 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:44.823905 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52949657-450c-4052-bf2b-103614f8cd28 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:44.824351 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52949657-450c-4052-bf2b-103614f8cd28 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:44.825156 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52949657-450c-4052-bf2b-103614f8cd28 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:44.825592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52949657-450c-4052-bf2b-103614f8cd28 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:44.918032 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-142fa29b-7f0a-4dbe-b5e9-6130861f96cb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:44.919291 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-142fa29b-7f0a-4dbe-b5e9-6130861f96cb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:44.925907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-142fa29b-7f0a-4dbe-b5e9-6130861f96cb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:44.926419 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-142fa29b-7f0a-4dbe-b5e9-6130861f96cb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:44.927751 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-142fa29b-7f0a-4dbe-b5e9-6130861f96cb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:44.928378 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-142fa29b-7f0a-4dbe-b5e9-6130861f96cb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:44.944310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:44.959952 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-52949657-450c-4052-bf2b-103614f8cd28 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:44.969298 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-52949657-450c-4052-bf2b-103614f8cd28 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1368 microversion: 2.1 time: 0.156540 May 19 13:58:44.970202 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 302/612] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:44 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:45.102009 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-142fa29b-7f0a-4dbe-b5e9-6130861f96cb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:45.112190 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-142fa29b-7f0a-4dbe-b5e9-6130861f96cb tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.197857 May 19 13:58:45.112777 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 311/613] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:44 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:45.259271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-a7ed6126-c44b-4ab5-a493-4c58bfa47f38 req-658a1d19-175d-417d-85d2-3216b30b3dbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2be2ac-8751-4467-9d51-1eee62e05dbe", "tag": "0034a6da-8683-41b5-98a9-fbbf91e91c4d"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:45.267415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-a7ed6126-c44b-4ab5-a493-4c58bfa47f38 req-658a1d19-175d-417d-85d2-3216b30b3dbd service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:45.268000 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-a7ed6126-c44b-4ab5-a493-4c58bfa47f38 req-658a1d19-175d-417d-85d2-3216b30b3dbd service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:45.285645 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-a7ed6126-c44b-4ab5-a493-4c58bfa47f38 req-658a1d19-175d-417d-85d2-3216b30b3dbd service nova] Creating event network-changed:0034a6da-8683-41b5-98a9-fbbf91e91c4d for instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe on hv-cinder-78481 May 19 13:58:45.291862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-a7ed6126-c44b-4ab5-a493-4c58bfa47f38 req-658a1d19-175d-417d-85d2-3216b30b3dbd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036669 May 19 13:58:45.292809 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 303/614] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:58:45.987360 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-92568ebd-7e25-4d3c-ab13-09085212f60f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:45.987926 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-92568ebd-7e25-4d3c-ab13-09085212f60f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:45.995069 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-92568ebd-7e25-4d3c-ab13-09085212f60f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:45.995521 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-92568ebd-7e25-4d3c-ab13-09085212f60f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:45.996284 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-92568ebd-7e25-4d3c-ab13-09085212f60f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:45.996721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-92568ebd-7e25-4d3c-ab13-09085212f60f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:46.124734 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-92568ebd-7e25-4d3c-ab13-09085212f60f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:46.130803 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-75efe89d-7e81-4e47-ad98-99865a1ed0f0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:46.131563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-75efe89d-7e81-4e47-ad98-99865a1ed0f0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:46.133317 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-92568ebd-7e25-4d3c-ab13-09085212f60f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1368 microversion: 2.1 time: 0.149829 May 19 13:58:46.133902 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 312/615] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:45 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:46.138168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75efe89d-7e81-4e47-ad98-99865a1ed0f0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:46.138616 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75efe89d-7e81-4e47-ad98-99865a1ed0f0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:46.139561 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75efe89d-7e81-4e47-ad98-99865a1ed0f0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:46.140048 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75efe89d-7e81-4e47-ad98-99865a1ed0f0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:46.278777 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-75efe89d-7e81-4e47-ad98-99865a1ed0f0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:46.287487 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-75efe89d-7e81-4e47-ad98-99865a1ed0f0 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.161124 May 19 13:58:46.288055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 304/616] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:46 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:47.150345 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1543d501-bcf9-4682-bb1d-786cff8607ee tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:47.150997 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1543d501-bcf9-4682-bb1d-786cff8607ee tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:47.157841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1543d501-bcf9-4682-bb1d-786cff8607ee tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:47.158298 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1543d501-bcf9-4682-bb1d-786cff8607ee tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:47.159119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1543d501-bcf9-4682-bb1d-786cff8607ee tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:47.159565 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1543d501-bcf9-4682-bb1d-786cff8607ee tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:47.299871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1543d501-bcf9-4682-bb1d-786cff8607ee tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:47.305069 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a15772ec-12b6-4318-8ea7-5735cd4e48b7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:47.305685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a15772ec-12b6-4318-8ea7-5735cd4e48b7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:47.309123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1543d501-bcf9-4682-bb1d-786cff8607ee tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1368 microversion: 2.1 time: 0.162868 May 19 13:58:47.318006 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 313/617] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:47 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:47.318258 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a15772ec-12b6-4318-8ea7-5735cd4e48b7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:47.318258 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a15772ec-12b6-4318-8ea7-5735cd4e48b7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:47.318258 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a15772ec-12b6-4318-8ea7-5735cd4e48b7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:47.318258 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a15772ec-12b6-4318-8ea7-5735cd4e48b7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:47.457505 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a15772ec-12b6-4318-8ea7-5735cd4e48b7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:47.466382 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a15772ec-12b6-4318-8ea7-5735cd4e48b7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.165132 May 19 13:58:47.467213 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 305/618] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:47 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:48.325591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8bd02de9-95d8-40c9-b7f2-2f5eb0031b2c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:48.326237 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8bd02de9-95d8-40c9-b7f2-2f5eb0031b2c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:48.332717 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8bd02de9-95d8-40c9-b7f2-2f5eb0031b2c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:48.333199 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8bd02de9-95d8-40c9-b7f2-2f5eb0031b2c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:48.334594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8bd02de9-95d8-40c9-b7f2-2f5eb0031b2c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:48.335056 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8bd02de9-95d8-40c9-b7f2-2f5eb0031b2c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:48.469541 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8bd02de9-95d8-40c9-b7f2-2f5eb0031b2c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:48.477509 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8bd02de9-95d8-40c9-b7f2-2f5eb0031b2c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1368 microversion: 2.1 time: 0.155907 May 19 13:58:48.478101 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 314/619] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:48 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:48.484703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-424261f2-f26d-4ed3-9314-020a6f46741b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:48.485310 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-424261f2-f26d-4ed3-9314-020a6f46741b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:48.492402 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-424261f2-f26d-4ed3-9314-020a6f46741b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:48.492843 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-424261f2-f26d-4ed3-9314-020a6f46741b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:48.493595 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-424261f2-f26d-4ed3-9314-020a6f46741b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:48.494023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-424261f2-f26d-4ed3-9314-020a6f46741b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:48.634164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-424261f2-f26d-4ed3-9314-020a6f46741b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:48.642150 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-424261f2-f26d-4ed3-9314-020a6f46741b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.161282 May 19 13:58:48.642709 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 306/620] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:48 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:49.494237 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d14f8651-5979-48a6-86b7-2f490e8973ed tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:49.494886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d14f8651-5979-48a6-86b7-2f490e8973ed tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:49.501556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d14f8651-5979-48a6-86b7-2f490e8973ed tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:49.502020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d14f8651-5979-48a6-86b7-2f490e8973ed tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:49.502783 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d14f8651-5979-48a6-86b7-2f490e8973ed tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:49.503248 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d14f8651-5979-48a6-86b7-2f490e8973ed tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:49.631577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d14f8651-5979-48a6-86b7-2f490e8973ed tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:49.638935 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d14f8651-5979-48a6-86b7-2f490e8973ed tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1368 microversion: 2.1 time: 0.148789 May 19 13:58:49.639492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 315/621] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:49 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:49.659902 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f672112f-2722-4818-a358-504e846b182b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:49.660444 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f672112f-2722-4818-a358-504e846b182b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:49.667655 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f672112f-2722-4818-a358-504e846b182b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:49.668099 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f672112f-2722-4818-a358-504e846b182b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:49.668856 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f672112f-2722-4818-a358-504e846b182b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:49.669292 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f672112f-2722-4818-a358-504e846b182b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:49.810460 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f672112f-2722-4818-a358-504e846b182b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:49.819254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f672112f-2722-4818-a358-504e846b182b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.163150 May 19 13:58:49.819818 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 307/622] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:49 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:50.656113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-08a1ad58-eab3-4f43-901b-77ef1bfa7a4f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:50.656731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-08a1ad58-eab3-4f43-901b-77ef1bfa7a4f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:50.663303 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-08a1ad58-eab3-4f43-901b-77ef1bfa7a4f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:50.663763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-08a1ad58-eab3-4f43-901b-77ef1bfa7a4f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:50.664525 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-08a1ad58-eab3-4f43-901b-77ef1bfa7a4f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:50.664967 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-08a1ad58-eab3-4f43-901b-77ef1bfa7a4f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:50.792032 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-08a1ad58-eab3-4f43-901b-77ef1bfa7a4f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:50.799399 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-08a1ad58-eab3-4f43-901b-77ef1bfa7a4f tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1368 microversion: 2.1 time: 0.147176 May 19 13:58:50.799958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 316/623] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:50 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:50.836097 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e65eb783-0160-4b48-bca4-533ccfd4dd9b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:50.836710 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e65eb783-0160-4b48-bca4-533ccfd4dd9b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:50.843290 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e65eb783-0160-4b48-bca4-533ccfd4dd9b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:50.843739 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e65eb783-0160-4b48-bca4-533ccfd4dd9b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:50.844506 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e65eb783-0160-4b48-bca4-533ccfd4dd9b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:50.844943 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e65eb783-0160-4b48-bca4-533ccfd4dd9b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:50.989621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e65eb783-0160-4b48-bca4-533ccfd4dd9b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:50.997680 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e65eb783-0160-4b48-bca4-533ccfd4dd9b tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.165360 May 19 13:58:50.998182 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 308/624] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:50 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:51.816793 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-87d3e4cb-ff1c-43b2-b1df-74ebe1565f04 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:51.817312 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-87d3e4cb-ff1c-43b2-b1df-74ebe1565f04 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:51.824509 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-87d3e4cb-ff1c-43b2-b1df-74ebe1565f04 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:51.824952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-87d3e4cb-ff1c-43b2-b1df-74ebe1565f04 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:51.825708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-87d3e4cb-ff1c-43b2-b1df-74ebe1565f04 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:51.826167 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-87d3e4cb-ff1c-43b2-b1df-74ebe1565f04 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:51.954528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-87d3e4cb-ff1c-43b2-b1df-74ebe1565f04 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:51.962099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-87d3e4cb-ff1c-43b2-b1df-74ebe1565f04 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1368 microversion: 2.1 time: 0.149270 May 19 13:58:51.962661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 317/625] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:51 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:58:52.014830 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-860f2976-dfb5-49f4-93af-0a65b99150f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:52.015470 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-860f2976-dfb5-49f4-93af-0a65b99150f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:52.022074 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-860f2976-dfb5-49f4-93af-0a65b99150f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:52.022520 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-860f2976-dfb5-49f4-93af-0a65b99150f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:52.023315 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-860f2976-dfb5-49f4-93af-0a65b99150f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:52.023755 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-860f2976-dfb5-49f4-93af-0a65b99150f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:52.170530 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-860f2976-dfb5-49f4-93af-0a65b99150f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:52.178633 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-860f2976-dfb5-49f4-93af-0a65b99150f6 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.167597 May 19 13:58:52.179240 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 309/626] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:52 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:52.432532 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-00596cf9-01ae-42bb-a4a1-457416010969 req-65034354-7c9c-476f-ba66-22f838b5aa72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2be2ac-8751-4467-9d51-1eee62e05dbe", "name": "network-vif-plugged", "status": "completed", "tag": "0034a6da-8683-41b5-98a9-fbbf91e91c4d"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:52.440965 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-00596cf9-01ae-42bb-a4a1-457416010969 req-65034354-7c9c-476f-ba66-22f838b5aa72 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:52.441532 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-00596cf9-01ae-42bb-a4a1-457416010969 req-65034354-7c9c-476f-ba66-22f838b5aa72 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:52.453911 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-00596cf9-01ae-42bb-a4a1-457416010969 req-65034354-7c9c-476f-ba66-22f838b5aa72 service nova] Creating event network-vif-plugged:0034a6da-8683-41b5-98a9-fbbf91e91c4d for instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe on hv-cinder-78481 May 19 13:58:52.459101 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-00596cf9-01ae-42bb-a4a1-457416010969 req-65034354-7c9c-476f-ba66-22f838b5aa72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030011 May 19 13:58:52.459861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 318/627] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:52.979179 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c67755a8-e65b-4509-bbbb-ab48efe4ce97 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:52.979782 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c67755a8-e65b-4509-bbbb-ab48efe4ce97 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:52.981704 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:52.982374 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=12 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:52.988096 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c67755a8-e65b-4509-bbbb-ab48efe4ce97 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:52.988546 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c67755a8-e65b-4509-bbbb-ab48efe4ce97 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:52.989303 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c67755a8-e65b-4509-bbbb-ab48efe4ce97 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:52.989744 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c67755a8-e65b-4509-bbbb-ab48efe4ce97 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:53.118406 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c67755a8-e65b-4509-bbbb-ab48efe4ce97 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:53.125839 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c67755a8-e65b-4509-bbbb-ab48efe4ce97 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1368 microversion: 2.1 time: 0.150568 May 19 13:58:53.126405 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 310/628] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:52 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:53.197108 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a33b9956-c0ac-40ac-90d4-43f0f7c09e6a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:53.197801 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a33b9956-c0ac-40ac-90d4-43f0f7c09e6a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:53.204533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a33b9956-c0ac-40ac-90d4-43f0f7c09e6a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:53.204976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a33b9956-c0ac-40ac-90d4-43f0f7c09e6a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:53.205725 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a33b9956-c0ac-40ac-90d4-43f0f7c09e6a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:53.206158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a33b9956-c0ac-40ac-90d4-43f0f7c09e6a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:53.346935 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a33b9956-c0ac-40ac-90d4-43f0f7c09e6a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:53.355483 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a33b9956-c0ac-40ac-90d4-43f0f7c09e6a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1756 microversion: 2.1 time: 0.163379 May 19 13:58:53.356045 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 319/629] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:53 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:54.142377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8c27d3a0-a02a-47a5-8899-f66e8034b9e9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:54.143016 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8c27d3a0-a02a-47a5-8899-f66e8034b9e9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:54.149644 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c27d3a0-a02a-47a5-8899-f66e8034b9e9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:54.150087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c27d3a0-a02a-47a5-8899-f66e8034b9e9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:54.150842 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c27d3a0-a02a-47a5-8899-f66e8034b9e9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:54.151296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c27d3a0-a02a-47a5-8899-f66e8034b9e9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:54.281899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8c27d3a0-a02a-47a5-8899-f66e8034b9e9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:54.289735 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8c27d3a0-a02a-47a5-8899-f66e8034b9e9 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1368 microversion: 2.1 time: 0.151185 May 19 13:58:54.290312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 311/630] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:54 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:54.372310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b6230914-b378-4573-91c9-d504b0826890 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:54.372960 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b6230914-b378-4573-91c9-d504b0826890 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:54.379483 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b6230914-b378-4573-91c9-d504b0826890 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:54.379938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b6230914-b378-4573-91c9-d504b0826890 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:54.381535 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b6230914-b378-4573-91c9-d504b0826890 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:54.382124 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b6230914-b378-4573-91c9-d504b0826890 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:54.523020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b6230914-b378-4573-91c9-d504b0826890 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:54.531492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b6230914-b378-4573-91c9-d504b0826890 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1759 microversion: 2.1 time: 0.162742 May 19 13:58:54.532067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 320/631] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:54 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:55.306253 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ce4d48b3-9dda-4fcc-ab3d-08c89d5611ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:55.306845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ce4d48b3-9dda-4fcc-ab3d-08c89d5611ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:55.313274 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce4d48b3-9dda-4fcc-ab3d-08c89d5611ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:55.313722 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce4d48b3-9dda-4fcc-ab3d-08c89d5611ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:55.314482 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce4d48b3-9dda-4fcc-ab3d-08c89d5611ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:55.314939 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce4d48b3-9dda-4fcc-ab3d-08c89d5611ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:55.447173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ce4d48b3-9dda-4fcc-ab3d-08c89d5611ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:55.454685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ce4d48b3-9dda-4fcc-ab3d-08c89d5611ff tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1558 microversion: 2.1 time: 0.153051 May 19 13:58:55.455295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 312/632] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:58:55 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:55.470556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a07e8dd8-0d31-4112-8028-de60632c7ad2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:55.471103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a07e8dd8-0d31-4112-8028-de60632c7ad2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:55.478367 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a07e8dd8-0d31-4112-8028-de60632c7ad2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:55.478825 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a07e8dd8-0d31-4112-8028-de60632c7ad2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:55.479642 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a07e8dd8-0d31-4112-8028-de60632c7ad2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:55.480084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a07e8dd8-0d31-4112-8028-de60632c7ad2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:55.556882 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a07e8dd8-0d31-4112-8028-de60632c7ad2 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090001 May 19 13:58:55.557421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 321/633] 10.222.0.52 () {58 vars in 1274 bytes} [Thu May 19 13:58:55 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:56.335852 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a9228c83-b216-432b-bf12-e77b32b2070c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:56.336380 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a9228c83-b216-432b-bf12-e77b32b2070c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:56.343126 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9228c83-b216-432b-bf12-e77b32b2070c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:56.343581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9228c83-b216-432b-bf12-e77b32b2070c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:56.344352 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9228c83-b216-432b-bf12-e77b32b2070c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:56.344943 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9228c83-b216-432b-bf12-e77b32b2070c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:56.373815 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a9228c83-b216-432b-bf12-e77b32b2070c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments/32718cf6-799c-4d56-b804-0b53ad86f817" status: 200 len: 194 microversion: 2.20 time: 0.042683 May 19 13:58:56.374403 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 313/634] 10.222.0.52 () {60 vars in 1453 bytes} [Thu May 19 13:58:56 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments/32718cf6-799c-4d56-b804-0b53ad86f817 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:58:56.444275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c88095ea-b13a-4557-a7d4-339afd404eea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:56.444892 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c88095ea-b13a-4557-a7d4-339afd404eea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:56.450783 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c88095ea-b13a-4557-a7d4-339afd404eea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:56.451275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c88095ea-b13a-4557-a7d4-339afd404eea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:56.452031 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c88095ea-b13a-4557-a7d4-339afd404eea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:56.452466 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c88095ea-b13a-4557-a7d4-339afd404eea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:56.542301 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-c88095ea-b13a-4557-a7d4-339afd404eea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lazy-loading 'services' on Instance uuid 5c4e2c2f-4753-4911-8859-73736543f959 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:58:56.661253 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c88095ea-b13a-4557-a7d4-339afd404eea tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments/32718cf6-799c-4d56-b804-0b53ad86f817" status: 202 len: 0 microversion: 2.20 time: 0.221448 May 19 13:58:56.661880 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 322/635] 10.222.0.52 () {60 vars in 1456 bytes} [Thu May 19 13:58:56 2022] DELETE /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments/32718cf6-799c-4d56-b804-0b53ad86f817 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 13:58:56.670972 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ab42dc15-8c75-4905-9bee-5758b31c0432 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:56.671958 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ab42dc15-8c75-4905-9bee-5758b31c0432 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:56.680077 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab42dc15-8c75-4905-9bee-5758b31c0432 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:56.680540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab42dc15-8c75-4905-9bee-5758b31c0432 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:56.681535 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab42dc15-8c75-4905-9bee-5758b31c0432 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:56.682993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab42dc15-8c75-4905-9bee-5758b31c0432 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:56.709050 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-d4aead17-90e8-428c-b30d-f4dd6b25c6af req-cf0a7086-2f89-47ff-8635-f22a53c4fe35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c2be2ac-8751-4467-9d51-1eee62e05dbe", "tag": "0034a6da-8683-41b5-98a9-fbbf91e91c4d"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:58:56.721281 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-d4aead17-90e8-428c-b30d-f4dd6b25c6af req-cf0a7086-2f89-47ff-8635-f22a53c4fe35 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:56.721730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-d4aead17-90e8-428c-b30d-f4dd6b25c6af req-cf0a7086-2f89-47ff-8635-f22a53c4fe35 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:56.731272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ab42dc15-8c75-4905-9bee-5758b31c0432 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064400 May 19 13:58:56.732224 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 314/636] 10.222.0.52 () {60 vars in 1342 bytes} [Thu May 19 13:58:56 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:58:56.739408 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-d4aead17-90e8-428c-b30d-f4dd6b25c6af req-cf0a7086-2f89-47ff-8635-f22a53c4fe35 service nova] Creating event network-changed:0034a6da-8683-41b5-98a9-fbbf91e91c4d for instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe on hv-cinder-78481 May 19 13:58:56.745018 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-d4aead17-90e8-428c-b30d-f4dd6b25c6af req-cf0a7086-2f89-47ff-8635-f22a53c4fe35 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041871 May 19 13:58:56.745607 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 323/637] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:58:57.743415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e757a407-5b56-496e-b33c-95ff1f22abf7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:57.744899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e757a407-5b56-496e-b33c-95ff1f22abf7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:57.751632 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e757a407-5b56-496e-b33c-95ff1f22abf7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:57.752092 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e757a407-5b56-496e-b33c-95ff1f22abf7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:57.752864 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e757a407-5b56-496e-b33c-95ff1f22abf7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:57.753299 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e757a407-5b56-496e-b33c-95ff1f22abf7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:57.784917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e757a407-5b56-496e-b33c-95ff1f22abf7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045544 May 19 13:58:57.785472 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 315/638] 10.222.0.52 () {60 vars in 1342 bytes} [Thu May 19 13:58:57 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:58:58.797635 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8cda224d-02bf-4b6e-8ec9-aa66c4d2e27f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:58.798632 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8cda224d-02bf-4b6e-8ec9-aa66c4d2e27f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:58.806123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8cda224d-02bf-4b6e-8ec9-aa66c4d2e27f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:58.806573 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8cda224d-02bf-4b6e-8ec9-aa66c4d2e27f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:58.807363 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8cda224d-02bf-4b6e-8ec9-aa66c4d2e27f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:58.807798 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8cda224d-02bf-4b6e-8ec9-aa66c4d2e27f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:58.838392 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8cda224d-02bf-4b6e-8ec9-aa66c4d2e27f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045121 May 19 13:58:58.838954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 324/639] 10.222.0.52 () {60 vars in 1342 bytes} [Thu May 19 13:58:58 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:58:58.897830 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-269db842-3a18-414e-9814-f52f74bf3e70 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:58.898329 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-269db842-3a18-414e-9814-f52f74bf3e70 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:58.905125 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269db842-3a18-414e-9814-f52f74bf3e70 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:58.905571 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269db842-3a18-414e-9814-f52f74bf3e70 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:58.906326 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269db842-3a18-414e-9814-f52f74bf3e70 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:58.906782 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269db842-3a18-414e-9814-f52f74bf3e70 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:58.931406 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-269db842-3a18-414e-9814-f52f74bf3e70 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:58:58.989539 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:58:59.007921 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-269db842-3a18-414e-9814-f52f74bf3e70 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 204 len: 0 microversion: 2.20 time: 0.113836 May 19 13:58:59.008730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 316/640] 10.222.0.52 () {60 vars in 1279 bytes} [Thu May 19 13:58:58 2022] DELETE /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 13:58:59.017372 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:58:59.017982 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:58:59.024672 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:59.025133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:59.025909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:58:59.026352 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:58:59.155078 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:59.163138 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:59.164644 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:58:59.165792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-56a383d2-0563-4722-a366-ff78dc179670 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.152462 May 19 13:58:59.166350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 325/641] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:58:59 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 13:59:00.184709 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:00.185490 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:00.193863 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:00.194401 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:00.195261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:00.195709 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:00.198843 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:00.330528 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:00.338602 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:00.340117 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:00.341253 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3cb37b39-38ea-43e4-b80a-70352994db6b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.160864 May 19 13:59:00.341802 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 317/642] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:00 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:01.359374 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:01.359984 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:01.367287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:01.367744 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:01.368513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:01.368952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:01.512905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:01.521271 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:01.522851 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:01.524111 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8244cb98-1d30-42f0-841b-4201a6f8604d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 200 len: 1722 microversion: 2.20 time: 0.168652 May 19 13:59:01.524676 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 326/643] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:01 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:01.895086 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-1084bc5c-9bcf-4d72-848e-a72d01fb6566 req-aefa2e88-1111-48d0-bbea-9c1a6663456d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c4e2c2f-4753-4911-8859-73736543f959", "name": "network-vif-deleted", "tag": "5e326997-1358-457a-8426-4184a94bfdad"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:01.905512 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-1084bc5c-9bcf-4d72-848e-a72d01fb6566 req-aefa2e88-1111-48d0-bbea-9c1a6663456d service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:01.906000 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-1084bc5c-9bcf-4d72-848e-a72d01fb6566 req-aefa2e88-1111-48d0-bbea-9c1a6663456d service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:01.918475 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-1084bc5c-9bcf-4d72-848e-a72d01fb6566 req-aefa2e88-1111-48d0-bbea-9c1a6663456d service nova] Creating event network-vif-deleted:5e326997-1358-457a-8426-4184a94bfdad for instance 5c4e2c2f-4753-4911-8859-73736543f959 on hv-cinder-78481 May 19 13:59:01.923357 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-1084bc5c-9bcf-4d72-848e-a72d01fb6566 req-aefa2e88-1111-48d0-bbea-9c1a6663456d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032421 May 19 13:59:01.924232 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 318/644] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:02.544167 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:02.545148 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:02.553390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:02.554071 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:02.555095 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:02.555543 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:02.571186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] HTTP exception thrown: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Request method failure captured: May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 HTTP/1.1 May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwT3QrnXodQhRSeSKg8o6b6b6gxWCTyjzATRo9jhLGjOCIquFLRqL97kJsEkNGCphotEQ6Op5IYXxf_jLe9qmDYMkfhmIrBnPmYniLfJezXIq__6Z7a96jz9OhFe6Uiscx14NcOWLccXjG67yfDaUJYoiUttAdbNjkTy6XTGYdhPC8 May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Openstack-Nova-Api-Version: 2.20 May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:59:02.572865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}] May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 00b21c3634cc41aca680152740644168 May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 13:59:02.574295 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '5c4e2c2f-4753-4911-8859-73736543f959'} May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:59:02.575156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 13:59:02.577183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:02.578929 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Returning 404 to user: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:59:02.578929 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2531ea6f-2a63-41b8-b6d1-a6029e26d64c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 404 len: 111 microversion: 2.20 time: 0.034388 May 19 13:59:02.578929 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 327/645] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:02 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 13:59:02.585005 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f2402c24-dcae-42d3-bf46-5ab64ef6f20f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '.version_select at 0x7f5de1c27dc0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:02.604610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f2402c24-dcae-42d3-bf46-5ab64ef6f20f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285268638" status: 204 len: 0 microversion: 2.20 time: 0.024494 May 19 13:59:02.605188 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 319/646] 10.222.0.52 () {60 vars in 1261 bytes} [Thu May 19 13:59:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285268638 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 13:59:03.237270 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-102552b6-87e5-46e1-a807-769301d5aeee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'create', calling method: .version_select at 0x7f5de2309ca0>, body: {"keypair": {"name": "tempest-keypair-547581664", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuBVvXtvJpAWyEm/BIIkgVTF4o+UXL9N8pGYcsts059wdBQVHU0Tl6xuQKI5fMJy+zlj1lT3IusmerIYe10CtKYMxLwB9wnKCepZUxs1aWLv3vFHyleZdH3a5tFgbeLfw=="}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:03.251097 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-102552b6-87e5-46e1-a807-769301d5aeee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Getting quotas for project 4eed7a893f7b42edaadbf898ebe16cd6. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:59:03.254881 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-102552b6-87e5-46e1-a807-769301d5aeee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Getting quotas for user 00b21c3634cc41aca680152740644168 and project 4eed7a893f7b42edaadbf898ebe16cd6. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:59:03.277629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-102552b6-87e5-46e1-a807-769301d5aeee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.044160 May 19 13:59:03.278216 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 328/647] 10.222.0.52 () {62 vars in 1199 bytes} [Thu May 19 13:59:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 13:59:04.536900 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-716073204", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad76f5bc-7148-40ee-8a08-ce1742f9a049"}], "security_groups": [{"name": "tempest-securitygroup--1429423197"}], "key_name": "tempest-keypair-547581664", "user_data": "}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:04.640748 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] validate_networks() for [('ad76f5bc-7148-40ee-8a08-ce1742f9a049', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:59:05.003317 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:59:05.003826 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:59:05.004301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:59:05.004710 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:59:05.005412 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:59:05.014630 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:05.015106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:05.015905 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:05.016343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:05.032591 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Getting quotas for project 4eed7a893f7b42edaadbf898ebe16cd6. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:59:05.036487 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Getting quotas for user 00b21c3634cc41aca680152740644168 and project 4eed7a893f7b42edaadbf898ebe16cd6. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:59:05.047417 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:59:05.049735 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:59:05.095886 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cdba1626-427e-4b0c-ab22-5d1587e4757e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.564296 May 19 13:59:05.096528 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 320/648] 10.222.0.52 () {62 vars in 1187 bytes} [Thu May 19 13:59:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 13:59:05.107622 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9757c88e-8238-4303-852a-a6104309bb47 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:05.108229 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9757c88e-8238-4303-852a-a6104309bb47 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:05.110154 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:05.165094 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9757c88e-8238-4303-852a-a6104309bb47 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:05.172268 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9757c88e-8238-4303-852a-a6104309bb47 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:05.173826 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9757c88e-8238-4303-852a-a6104309bb47 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:05.174955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9757c88e-8238-4303-852a-a6104309bb47 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1280 microversion: 2.20 time: 0.071713 May 19 13:59:05.175509 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 329/649] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:05 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:06.193691 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:06.194610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:06.202782 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:06.203270 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:06.204031 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:06.204651 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:06.273708 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:06.281973 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:06.283513 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:06.284629 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d49977e4-d42b-419d-8146-d524d7add082 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1350 microversion: 2.20 time: 0.095589 May 19 13:59:06.285185 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 321/650] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:06 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:07.303449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:07.303990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:07.310370 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:07.310819 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:07.311613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:07.312046 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:07.448013 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:07.456031 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:07.457830 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:07.459976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2ac0ab2c-482d-46b6-912b-fe48c2106005 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.161243 May 19 13:59:07.460549 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 330/651] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:07 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:07.701058 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-9ca4f184-9092-48f1-8524-845fce51c93a req-1d740275-4f89-45e5-a717-bc14d4d0d6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea89fb6-a6ad-4aaf-9c6a-c06816051a96", "tag": "b57d1bfa-eb18-42d5-a8b6-81fae3792bb9"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:07.713467 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9ca4f184-9092-48f1-8524-845fce51c93a req-1d740275-4f89-45e5-a717-bc14d4d0d6db service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:07.714275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9ca4f184-9092-48f1-8524-845fce51c93a req-1d740275-4f89-45e5-a717-bc14d4d0d6db service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:07.737106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-9ca4f184-9092-48f1-8524-845fce51c93a req-1d740275-4f89-45e5-a717-bc14d4d0d6db service nova] Creating event network-changed:b57d1bfa-eb18-42d5-a8b6-81fae3792bb9 for instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 on hv-cinder-78481 May 19 13:59:07.743719 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-9ca4f184-9092-48f1-8524-845fce51c93a req-1d740275-4f89-45e5-a717-bc14d4d0d6db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045876 May 19 13:59:07.745142 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 322/652] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:59:08.479384 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:08.479996 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:08.486489 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:08.486974 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:08.487737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:08.488208 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:08.615231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:08.617706 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:08.624491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:08.625979 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:08.627100 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f5b62f2f-6931-4ec5-beca-760d9f3d727f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.151900 May 19 13:59:08.627655 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 331/653] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:08 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:09.646097 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:09.647346 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:09.654166 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:09.654558 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:09.655400 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:09.655841 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:09.785039 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:09.793196 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:09.794707 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:09.795846 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-12769554-e9a7-4680-91dc-0199711c7171 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.154041 May 19 13:59:09.796401 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 323/654] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:09 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:10.814125 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:10.814643 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:10.822058 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:10.822510 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:10.823314 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:10.823757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:10.953297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:10.961705 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:10.963226 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:10.964332 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9da88372-2cf0-4b58-9e8c-3475d130330c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.154310 May 19 13:59:10.964880 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 332/655] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:10 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:11.982358 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:11.983002 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:11.989613 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:11.990066 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:11.991539 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:11.992270 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:12.118838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:12.126881 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:12.128381 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:12.129473 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-69281562-9858-4c3b-bf38-6cf490b20707 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.151077 May 19 13:59:12.130015 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 324/656] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:11 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:13.147547 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:13.148344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:13.154588 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:13.155080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:13.155839 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:13.156273 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:13.289471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:13.297303 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:13.298931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:13.300057 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-af904243-0f31-425f-8107-91ca02261649 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.156494 May 19 13:59:13.300600 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 333/657] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:13 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:13.722736 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f7b70f28-8e73-438c-9a7f-cbc9de9e13db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:13.723283 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f7b70f28-8e73-438c-9a7f-cbc9de9e13db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:13.730246 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7b70f28-8e73-438c-9a7f-cbc9de9e13db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:13.730690 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7b70f28-8e73-438c-9a7f-cbc9de9e13db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:13.731490 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7b70f28-8e73-438c-9a7f-cbc9de9e13db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:13.731938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7b70f28-8e73-438c-9a7f-cbc9de9e13db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:13.812271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-f7b70f28-8e73-438c-9a7f-cbc9de9e13db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lazy-loading 'services' on Instance uuid 83247503-3bc5-4f4d-9221-acd8b14033e8 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:59:13.883474 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f7b70f28-8e73-438c-9a7f-cbc9de9e13db tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "DELETE /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments/71643f73-657e-40a8-b0ec-d984e6565363" status: 202 len: 0 microversion: 2.1 time: 0.164409 May 19 13:59:13.884056 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 325/658] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 13:59:13 2022] DELETE /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments/71643f73-657e-40a8-b0ec-d984e6565363 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:59:13.892425 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3af34544-c30a-4467-830e-05164cb74014 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:13.893414 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3af34544-c30a-4467-830e-05164cb74014 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:13.900587 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3af34544-c30a-4467-830e-05164cb74014 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:13.901194 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3af34544-c30a-4467-830e-05164cb74014 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:13.901987 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3af34544-c30a-4467-830e-05164cb74014 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:13.902462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3af34544-c30a-4467-830e-05164cb74014 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:13.934884 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3af34544-c30a-4467-830e-05164cb74014 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046286 May 19 13:59:13.935396 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 334/659] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:59:13 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:14.318679 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:14.319878 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:14.326001 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:14.326446 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:14.327311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:14.327745 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:14.462616 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:14.471926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:14.473531 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:14.474754 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5b5e626a-be37-4f7f-b4d2-0a167d1279e2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.160324 May 19 13:59:14.475342 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 326/660] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:14 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:14.489958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-80ae5b77-2db9-4707-8044-2b4548337370 req-678ecd43-9e46-4e25-b7ba-af45a2976f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea89fb6-a6ad-4aaf-9c6a-c06816051a96", "name": "network-vif-plugged", "status": "completed", "tag": "b57d1bfa-eb18-42d5-a8b6-81fae3792bb9"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:14.499411 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-80ae5b77-2db9-4707-8044-2b4548337370 req-678ecd43-9e46-4e25-b7ba-af45a2976f9e service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:14.499854 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-80ae5b77-2db9-4707-8044-2b4548337370 req-678ecd43-9e46-4e25-b7ba-af45a2976f9e service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:14.512121 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-80ae5b77-2db9-4707-8044-2b4548337370 req-678ecd43-9e46-4e25-b7ba-af45a2976f9e service nova] Creating event network-vif-plugged:b57d1bfa-eb18-42d5-a8b6-81fae3792bb9 for instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 on hv-cinder-78481 May 19 13:59:14.520021 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-80ae5b77-2db9-4707-8044-2b4548337370 req-678ecd43-9e46-4e25-b7ba-af45a2976f9e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033662 May 19 13:59:14.520653 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 335/661] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:14.947996 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8d779588-4c93-4198-8047-e93505b55cc2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:14.948948 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8d779588-4c93-4198-8047-e93505b55cc2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:14.955875 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8d779588-4c93-4198-8047-e93505b55cc2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:14.956332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8d779588-4c93-4198-8047-e93505b55cc2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:14.957167 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8d779588-4c93-4198-8047-e93505b55cc2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:14.957615 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8d779588-4c93-4198-8047-e93505b55cc2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:14.989722 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8d779588-4c93-4198-8047-e93505b55cc2 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046507 May 19 13:59:14.990295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 327/662] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:59:14 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:59:15.066409 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f2d40054-4b83-4102-b622-c8bbfc2e7cef tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:15.067020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f2d40054-4b83-4102-b622-c8bbfc2e7cef tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:15.073257 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2d40054-4b83-4102-b622-c8bbfc2e7cef tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:15.073707 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2d40054-4b83-4102-b622-c8bbfc2e7cef tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:15.074484 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2d40054-4b83-4102-b622-c8bbfc2e7cef tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:15.074958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2d40054-4b83-4102-b622-c8bbfc2e7cef tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:15.098842 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f2d40054-4b83-4102-b622-c8bbfc2e7cef tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Going to try to terminate instance {{(pid=123751) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:59:15.170078 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=6 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:15.177918 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f2d40054-4b83-4102-b622-c8bbfc2e7cef tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "DELETE /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 204 len: 0 microversion: 2.1 time: 0.115651 May 19 13:59:15.179075 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 336/663] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:59:15 2022] DELETE /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:59:15.187045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cb4ad043-c0cd-4d5b-8bac-be1aea65e70c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:15.187667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cb4ad043-c0cd-4d5b-8bac-be1aea65e70c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:15.189611 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:15.190252 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=6 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:15.196499 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4ad043-c0cd-4d5b-8bac-be1aea65e70c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:15.196950 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4ad043-c0cd-4d5b-8bac-be1aea65e70c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:15.197716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4ad043-c0cd-4d5b-8bac-be1aea65e70c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:15.198152 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4ad043-c0cd-4d5b-8bac-be1aea65e70c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:15.441806 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cb4ad043-c0cd-4d5b-8bac-be1aea65e70c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:15.449351 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cb4ad043-c0cd-4d5b-8bac-be1aea65e70c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1687 microversion: 2.1 time: 0.266217 May 19 13:59:15.449919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 328/664] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:15 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1687 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:59:15.492075 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:15.492782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:15.498931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:15.499383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:15.500141 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:15.500579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:15.678184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:15.686264 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:15.687729 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:15.688821 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ef95638d-7973-428b-9be8-0d9fe64d6133 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.201093 May 19 13:59:15.689369 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 337/665] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:15 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:16.466109 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0cb43b87-949e-487f-ad7c-d7881ef27a76 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:16.466721 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0cb43b87-949e-487f-ad7c-d7881ef27a76 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:16.473238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb43b87-949e-487f-ad7c-d7881ef27a76 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:16.473686 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb43b87-949e-487f-ad7c-d7881ef27a76 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:16.474479 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb43b87-949e-487f-ad7c-d7881ef27a76 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:16.474932 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb43b87-949e-487f-ad7c-d7881ef27a76 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:16.603439 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0cb43b87-949e-487f-ad7c-d7881ef27a76 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:16.611006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0cb43b87-949e-487f-ad7c-d7881ef27a76 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1687 microversion: 2.1 time: 0.148697 May 19 13:59:16.611567 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 329/666] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:16 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:16.707388 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:16.707998 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:16.714468 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:16.714944 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:16.715710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:16.716147 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:16.845383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:16.854115 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:16.855589 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:16.856686 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5140b642-35e2-496d-b248-6d5ebbf798c4 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.153162 May 19 13:59:16.857241 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 338/667] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:16 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:17.629649 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a0a18014-7a58-4082-81ab-407d05884fca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:17.630521 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a0a18014-7a58-4082-81ab-407d05884fca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:17.637936 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0a18014-7a58-4082-81ab-407d05884fca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:17.638385 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0a18014-7a58-4082-81ab-407d05884fca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:17.639916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0a18014-7a58-4082-81ab-407d05884fca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:17.640368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0a18014-7a58-4082-81ab-407d05884fca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:17.782218 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a0a18014-7a58-4082-81ab-407d05884fca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:17.793497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a0a18014-7a58-4082-81ab-407d05884fca tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1687 microversion: 2.1 time: 0.167739 May 19 13:59:17.794097 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 330/668] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:17 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:17.874674 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:17.875388 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:17.882676 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:17.883159 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:17.883930 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:17.884370 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:18.034282 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:18.047126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:18.048981 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:18.050093 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-891fb760-a406-43b1-8e2e-df6b98ed4bfd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.179409 May 19 13:59:18.050647 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 339/669] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:17 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:18.810361 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-58245562-e988-4b35-b49b-32e46491529c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:18.810912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-58245562-e988-4b35-b49b-32e46491529c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:18.817277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-58245562-e988-4b35-b49b-32e46491529c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:18.817756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-58245562-e988-4b35-b49b-32e46491529c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:18.818507 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-58245562-e988-4b35-b49b-32e46491529c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:18.819696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-58245562-e988-4b35-b49b-32e46491529c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:18.947962 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-58245562-e988-4b35-b49b-32e46491529c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:18.955455 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-58245562-e988-4b35-b49b-32e46491529c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1687 microversion: 2.1 time: 0.148980 May 19 13:59:18.956019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 331/670] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:18 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:19.068696 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:19.069912 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:19.076331 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:19.076781 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:19.077537 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:19.077972 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:19.203169 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:19.211381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:19.212885 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:19.213991 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-dd8c6920-7e6a-4810-a923-fa1767a94c2d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1406 microversion: 2.20 time: 0.149235 May 19 13:59:19.214547 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 340/671] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:19 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:19.973107 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1a89af3c-9a8e-4c7a-a4d3-5e7a0e3c11f5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:19.973723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1a89af3c-9a8e-4c7a-a4d3-5e7a0e3c11f5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:19.980861 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1a89af3c-9a8e-4c7a-a4d3-5e7a0e3c11f5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:19.981309 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1a89af3c-9a8e-4c7a-a4d3-5e7a0e3c11f5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:19.982074 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1a89af3c-9a8e-4c7a-a4d3-5e7a0e3c11f5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:19.982516 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1a89af3c-9a8e-4c7a-a4d3-5e7a0e3c11f5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:20.111673 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1a89af3c-9a8e-4c7a-a4d3-5e7a0e3c11f5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:20.119530 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1a89af3c-9a8e-4c7a-a4d3-5e7a0e3c11f5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1687 microversion: 2.1 time: 0.150284 May 19 13:59:20.120102 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 332/672] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:19 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:20.232500 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:20.233019 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:20.239691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:20.240136 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:20.241022 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:20.241481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:20.368305 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:20.376200 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:20.377698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:20.378836 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6bc7ffc5-f10e-4da9-90cd-66c5f438d8e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1598 microversion: 2.20 time: 0.151081 May 19 13:59:20.379418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 341/673] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 13:59:20 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1598 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 13:59:20.400463 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7d1eee8d-50e6-49dc-aa9a-cfdc5e8a058c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:20.400955 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7d1eee8d-50e6-49dc-aa9a-cfdc5e8a058c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:20.406902 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d1eee8d-50e6-49dc-aa9a-cfdc5e8a058c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:20.407352 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d1eee8d-50e6-49dc-aa9a-cfdc5e8a058c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:20.408109 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d1eee8d-50e6-49dc-aa9a-cfdc5e8a058c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:20.408541 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d1eee8d-50e6-49dc-aa9a-cfdc5e8a058c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:20.489054 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7d1eee8d-50e6-49dc-aa9a-cfdc5e8a058c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093032 May 19 13:59:20.489647 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 333/674] 10.222.0.52 () {60 vars in 1315 bytes} [Thu May 19 13:59:20 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 13:59:21.136505 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-de2c6612-a6bc-46cf-bf2d-f97a13bcbefd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:21.137126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-de2c6612-a6bc-46cf-bf2d-f97a13bcbefd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:21.143112 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de2c6612-a6bc-46cf-bf2d-f97a13bcbefd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:21.143561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de2c6612-a6bc-46cf-bf2d-f97a13bcbefd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:21.144505 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de2c6612-a6bc-46cf-bf2d-f97a13bcbefd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:21.144950 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-de2c6612-a6bc-46cf-bf2d-f97a13bcbefd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:21.224780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-de2c6612-a6bc-46cf-bf2d-f97a13bcbefd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:21.233675 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-de2c6612-a6bc-46cf-bf2d-f97a13bcbefd tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 200 len: 1620 microversion: 2.1 time: 0.101084 May 19 13:59:21.234587 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 342/675] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:21 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 1620 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:21.485384 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-c3fabcb4-0d56-4c4d-93e6-19e8f33d655b req-98901b67-d59f-4ae0-a4ce-8bd569a69a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83247503-3bc5-4f4d-9221-acd8b14033e8", "name": "network-vif-deleted", "tag": "9636a338-81c2-4e01-8620-ce36ba238295"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:21.499748 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-c3fabcb4-0d56-4c4d-93e6-19e8f33d655b req-98901b67-d59f-4ae0-a4ce-8bd569a69a57 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:21.500475 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-c3fabcb4-0d56-4c4d-93e6-19e8f33d655b req-98901b67-d59f-4ae0-a4ce-8bd569a69a57 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:21.513212 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-c3fabcb4-0d56-4c4d-93e6-19e8f33d655b req-98901b67-d59f-4ae0-a4ce-8bd569a69a57 service nova] Creating event network-vif-deleted:9636a338-81c2-4e01-8620-ce36ba238295 for instance 83247503-3bc5-4f4d-9221-acd8b14033e8 on hv-cinder-78481 May 19 13:59:21.519954 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-c3fabcb4-0d56-4c4d-93e6-19e8f33d655b req-98901b67-d59f-4ae0-a4ce-8bd569a69a57 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049346 May 19 13:59:21.521523 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 334/676] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:59:21.790468 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-190b7719-f8d4-45fa-9171-56a5cdbd1dd6 req-424ae9a9-9753-4c22-9c45-5456b19fe4cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea89fb6-a6ad-4aaf-9c6a-c06816051a96", "tag": "b57d1bfa-eb18-42d5-a8b6-81fae3792bb9"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:21.801032 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-190b7719-f8d4-45fa-9171-56a5cdbd1dd6 req-424ae9a9-9753-4c22-9c45-5456b19fe4cf service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:21.801759 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-190b7719-f8d4-45fa-9171-56a5cdbd1dd6 req-424ae9a9-9753-4c22-9c45-5456b19fe4cf service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:21.816288 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-190b7719-f8d4-45fa-9171-56a5cdbd1dd6 req-424ae9a9-9753-4c22-9c45-5456b19fe4cf service nova] Creating event network-changed:b57d1bfa-eb18-42d5-a8b6-81fae3792bb9 for instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 on hv-cinder-78481 May 19 13:59:21.822710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-190b7719-f8d4-45fa-9171-56a5cdbd1dd6 req-424ae9a9-9753-4c22-9c45-5456b19fe4cf service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036627 May 19 13:59:21.824006 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 343/677] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:22.255937 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:22.259042 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 83247503-3bc5-4f4d-9221-acd8b14033e8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:22.268608 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:22.269361 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:22.270504 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:22.271349 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:22.307635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] HTTP exception thrown: Instance 83247503-3bc5-4f4d-9221-acd8b14033e8 could not be found. May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Request method failure captured: May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 HTTP/1.1 May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwR8hzgIQIvgXeEM5L2dMhVxvBFzRTgSVN6ic_FVvk5L-iPskc47LcpgVydeVUCvM0x7XfiA91dw9McFpEV16_PqPrAs7WDyu_9PxCp_2nJTUBv4popy6qF1P2_PDF8M1xIqMvUfN4G_EW0aX6yCiNb6CHv7jCtLFHzhW1M2f-GVSU May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:59:22.310464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}] May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: 698ccea06fb24beea18c679d53f907a6 May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 83247503-3bc5-4f4d-9221-acd8b14033e8 could not be found. May 19 13:59:22.312108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '83247503-3bc5-4f4d-9221-acd8b14033e8'} May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83247503-3bc5-4f4d-9221-acd8b14033e8 could not be found. May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:59:22.313006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83247503-3bc5-4f4d-9221-acd8b14033e8 could not be found. May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83247503-3bc5-4f4d-9221-acd8b14033e8 could not be found. May 19 13:59:22.314414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:22.318272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Returning 404 to user: Instance 83247503-3bc5-4f4d-9221-acd8b14033e8 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:59:22.320115 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-03c2b09a-0cfd-42e0-be6a-95940cbc4240 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8" status: 404 len: 111 microversion: 2.1 time: 0.072561 May 19 13:59:22.320964 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 335/678] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:22 2022] GET /compute/v2.1/servers/83247503-3bc5-4f4d-9221-acd8b14033e8 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:59:22.349144 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1486606b-01e8-4c9e-8670-8338465a9ecf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '.version_select at 0x7f5de22731f0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:22.374129 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1486606b-01e8-4c9e-8670-8338465a9ecf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-915409444" status: 202 len: 0 microversion: 2.1 time: 0.048420 May 19 13:59:22.375298 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 344/679] 10.222.0.52 () {58 vars in 1217 bytes} [Thu May 19 13:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-915409444 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:59:25.636032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c867cd97-1fdd-4659-9748-5637405dc104 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:25.636582 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c867cd97-1fdd-4659-9748-5637405dc104 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:25.642753 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c867cd97-1fdd-4659-9748-5637405dc104 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:25.643243 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c867cd97-1fdd-4659-9748-5637405dc104 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:25.644014 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c867cd97-1fdd-4659-9748-5637405dc104 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:25.644445 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c867cd97-1fdd-4659-9748-5637405dc104 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:25.670296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c867cd97-1fdd-4659-9748-5637405dc104 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:59:25.702520 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:25.746892 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c867cd97-1fdd-4659-9748-5637405dc104 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "DELETE /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 204 len: 0 microversion: 2.1 time: 0.114471 May 19 13:59:25.747892 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 336/680] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:59:25 2022] DELETE /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:59:25.756905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-69cd5777-0bf8-443b-94fc-ca99a418218c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:25.757638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-69cd5777-0bf8-443b-94fc-ca99a418218c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:25.764446 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-69cd5777-0bf8-443b-94fc-ca99a418218c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:25.764902 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-69cd5777-0bf8-443b-94fc-ca99a418218c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:25.765661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-69cd5777-0bf8-443b-94fc-ca99a418218c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:25.766126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-69cd5777-0bf8-443b-94fc-ca99a418218c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:25.895774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-69cd5777-0bf8-443b-94fc-ca99a418218c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:25.903994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-69cd5777-0bf8-443b-94fc-ca99a418218c tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1507 microversion: 2.1 time: 0.152077 May 19 13:59:25.904558 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 345/681] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:25 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:26.922525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bb73f37b-80ef-456d-a1c4-5aea4b7654ac tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:26.923255 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bb73f37b-80ef-456d-a1c4-5aea4b7654ac tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:26.929773 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bb73f37b-80ef-456d-a1c4-5aea4b7654ac tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:26.930227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bb73f37b-80ef-456d-a1c4-5aea4b7654ac tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:26.931725 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bb73f37b-80ef-456d-a1c4-5aea4b7654ac tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:26.932164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bb73f37b-80ef-456d-a1c4-5aea4b7654ac tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:27.059294 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bb73f37b-80ef-456d-a1c4-5aea4b7654ac tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:27.066745 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bb73f37b-80ef-456d-a1c4-5aea4b7654ac tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1507 microversion: 2.1 time: 0.148493 May 19 13:59:27.067340 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 337/682] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:26 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:28.083605 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-935f6e9a-e4c0-4804-a5b6-8749d4c068bf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:28.084219 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-935f6e9a-e4c0-4804-a5b6-8749d4c068bf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:28.091284 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-935f6e9a-e4c0-4804-a5b6-8749d4c068bf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:28.091739 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-935f6e9a-e4c0-4804-a5b6-8749d4c068bf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:28.092515 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-935f6e9a-e4c0-4804-a5b6-8749d4c068bf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:28.092955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-935f6e9a-e4c0-4804-a5b6-8749d4c068bf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:28.224747 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-935f6e9a-e4c0-4804-a5b6-8749d4c068bf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:28.232555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-935f6e9a-e4c0-4804-a5b6-8749d4c068bf tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1507 microversion: 2.1 time: 0.152849 May 19 13:59:28.233117 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 346/683] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:28 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:28.845061 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-7bd701f4-c7ea-43cb-a918-821a725222e0 req-f59c8971-f260-486e-991a-f590865fd3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac7a1c-80e3-46ab-a5a0-2135ac395d2f", "name": "network-vif-deleted", "tag": "9c788124-2671-444c-98f8-1098c854377e"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:28.855351 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7bd701f4-c7ea-43cb-a918-821a725222e0 req-f59c8971-f260-486e-991a-f590865fd3b2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:28.855794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7bd701f4-c7ea-43cb-a918-821a725222e0 req-f59c8971-f260-486e-991a-f590865fd3b2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:28.866735 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-7bd701f4-c7ea-43cb-a918-821a725222e0 req-f59c8971-f260-486e-991a-f590865fd3b2 service nova] Creating event network-vif-deleted:9c788124-2671-444c-98f8-1098c854377e for instance aaac7a1c-80e3-46ab-a5a0-2135ac395d2f on hv-cinder-78481 May 19 13:59:28.872367 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-7bd701f4-c7ea-43cb-a918-821a725222e0 req-f59c8971-f260-486e-991a-f590865fd3b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030888 May 19 13:59:28.873060 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 338/684] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:29.249506 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:29.250148 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:29.256869 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:29.257434 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:29.258198 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:29.259163 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:29.290772 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:29.291244 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:29.291697 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lazy-loading 'fault' on Instance uuid aaac7a1c-80e3-46ab-a5a0-2135ac395d2f {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:59:29.334891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:29.344073 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-22ca402f-eb50-4ba0-b20f-1374542e402a tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 200 len: 1312 microversion: 2.1 time: 0.098218 May 19 13:59:29.344763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 347/685] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:29 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:30.362218 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:30.362923 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: aaac7a1c-80e3-46ab-a5a0-2135ac395d2f] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:30.364850 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:30.371418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:30.371858 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:30.372613 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:30.373045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:30.389212 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] HTTP exception thrown: Instance aaac7a1c-80e3-46ab-a5a0-2135ac395d2f could not be found. May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Request method failure captured: May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f HTTP/1.1 May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwR8hzgIQIvgXeEM5L2dMhVxvBFzRTgSVN6ic_FVvk5L-iPskc47LcpgVydeVUCvM0x7XfiA91dw9McFpEV16_PqPrAs7WDyu_9PxCp_2nJTUBv4popy6qF1P2_PDF8M1xIqMvUfN4G_EW0aX6yCiNb6CHv7jCtLFHzhW1M2f-GVSU May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:59:30.390838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}] May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: 698ccea06fb24beea18c679d53f907a6 May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance aaac7a1c-80e3-46ab-a5a0-2135ac395d2f could not be found. May 19 13:59:30.392230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': 'aaac7a1c-80e3-46ab-a5a0-2135ac395d2f'} May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaac7a1c-80e3-46ab-a5a0-2135ac395d2f could not be found. May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:59:30.393010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaac7a1c-80e3-46ab-a5a0-2135ac395d2f could not be found. May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaac7a1c-80e3-46ab-a5a0-2135ac395d2f could not be found. May 19 13:59:30.394237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:30.395592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Returning 404 to user: Instance aaac7a1c-80e3-46ab-a5a0-2135ac395d2f could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:59:30.395592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8ba0fc92-6980-48a4-b38c-8d2eb176d759 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f" status: 404 len: 111 microversion: 2.1 time: 0.034696 May 19 13:59:30.395592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 339/686] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:30 2022] GET /compute/v2.1/servers/aaac7a1c-80e3-46ab-a5a0-2135ac395d2f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:59:30.402398 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-085b488b-de37-4bdd-8be5-be4c6342facb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:30.402398 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-085b488b-de37-4bdd-8be5-be4c6342facb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:30.408886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-085b488b-de37-4bdd-8be5-be4c6342facb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:30.409346 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-085b488b-de37-4bdd-8be5-be4c6342facb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:30.410118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-085b488b-de37-4bdd-8be5-be4c6342facb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:30.410560 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-085b488b-de37-4bdd-8be5-be4c6342facb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:30.437431 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-085b488b-de37-4bdd-8be5-be4c6342facb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Going to try to terminate instance {{(pid=123751) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:59:30.440212 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:30.679717 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-085b488b-de37-4bdd-8be5-be4c6342facb tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 204 len: 0 microversion: 2.1 time: 0.282121 May 19 13:59:30.680425 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 348/687] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:59:30 2022] DELETE /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:59:30.690897 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d44ce5ce-1953-40f2-9ae5-e5a2297d7448 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:30.691837 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d44ce5ce-1953-40f2-9ae5-e5a2297d7448 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:30.698573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d44ce5ce-1953-40f2-9ae5-e5a2297d7448 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:30.699072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d44ce5ce-1953-40f2-9ae5-e5a2297d7448 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:30.699846 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d44ce5ce-1953-40f2-9ae5-e5a2297d7448 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:30.700280 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d44ce5ce-1953-40f2-9ae5-e5a2297d7448 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:30.830282 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d44ce5ce-1953-40f2-9ae5-e5a2297d7448 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:30.838019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d44ce5ce-1953-40f2-9ae5-e5a2297d7448 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.152596 May 19 13:59:30.838775 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 340/688] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:30 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:31.856892 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bc772c3d-7dfc-4d6d-b4b5-0d9994f85cbc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:31.857583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bc772c3d-7dfc-4d6d-b4b5-0d9994f85cbc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:31.864033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bc772c3d-7dfc-4d6d-b4b5-0d9994f85cbc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:31.864478 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bc772c3d-7dfc-4d6d-b4b5-0d9994f85cbc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:31.865231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bc772c3d-7dfc-4d6d-b4b5-0d9994f85cbc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:31.865663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bc772c3d-7dfc-4d6d-b4b5-0d9994f85cbc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:32.000463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bc772c3d-7dfc-4d6d-b4b5-0d9994f85cbc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:32.008197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bc772c3d-7dfc-4d6d-b4b5-0d9994f85cbc tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.156348 May 19 13:59:32.008928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 349/689] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:31 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:33.025461 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-39e4d760-d48c-437f-bbe6-209488f3fd24 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:33.026072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-39e4d760-d48c-437f-bbe6-209488f3fd24 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:33.032570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39e4d760-d48c-437f-bbe6-209488f3fd24 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:33.033016 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39e4d760-d48c-437f-bbe6-209488f3fd24 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:33.033765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39e4d760-d48c-437f-bbe6-209488f3fd24 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:33.034194 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39e4d760-d48c-437f-bbe6-209488f3fd24 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:33.164007 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-39e4d760-d48c-437f-bbe6-209488f3fd24 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:33.171671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-39e4d760-d48c-437f-bbe6-209488f3fd24 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.150387 May 19 13:59:33.172230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 341/690] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:33 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:34.188615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-74fbb2f2-42fb-4fd0-a85c-bbb4531aa465 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:34.189847 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-74fbb2f2-42fb-4fd0-a85c-bbb4531aa465 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:34.196575 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-74fbb2f2-42fb-4fd0-a85c-bbb4531aa465 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:34.197022 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-74fbb2f2-42fb-4fd0-a85c-bbb4531aa465 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:34.197788 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-74fbb2f2-42fb-4fd0-a85c-bbb4531aa465 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:34.198228 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-74fbb2f2-42fb-4fd0-a85c-bbb4531aa465 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:34.328465 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-74fbb2f2-42fb-4fd0-a85c-bbb4531aa465 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:34.335878 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-74fbb2f2-42fb-4fd0-a85c-bbb4531aa465 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1519 microversion: 2.1 time: 0.151246 May 19 13:59:34.336428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 350/691] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:34 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:34.834061 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-ab667e64-ec27-42cb-866f-de6a08e1d160 req-5dbfd09e-2ebd-448b-8b2f-972a545559f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0a5331-be2a-4c5b-80ac-6be7220f2516", "name": "network-vif-deleted", "tag": "1c2ca481-d8b3-43c5-9df6-5b028371dcf0"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:34.845026 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ab667e64-ec27-42cb-866f-de6a08e1d160 req-5dbfd09e-2ebd-448b-8b2f-972a545559f4 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:34.845448 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ab667e64-ec27-42cb-866f-de6a08e1d160 req-5dbfd09e-2ebd-448b-8b2f-972a545559f4 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:34.857514 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-ab667e64-ec27-42cb-866f-de6a08e1d160 req-5dbfd09e-2ebd-448b-8b2f-972a545559f4 service nova] Creating event network-vif-deleted:1c2ca481-d8b3-43c5-9df6-5b028371dcf0 for instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 on hv-cinder-78481 May 19 13:59:34.863436 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-ab667e64-ec27-42cb-866f-de6a08e1d160 req-5dbfd09e-2ebd-448b-8b2f-972a545559f4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033177 May 19 13:59:34.864579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 342/692] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:35.353476 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:35.354065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:35.356502 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:35.362420 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:35.362973 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:35.363781 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:35.364226 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:35.403636 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:35.404093 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:35.404549 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lazy-loading 'fault' on Instance uuid 2b0a5331-be2a-4c5b-80ac-6be7220f2516 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:59:35.445459 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '698ccea06fb24beea18c679d53f907a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28027af4cc0c4ca99035e48aa6237805', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:35.453170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ef4a9521-e4fc-4cac-bb89-a740173751e5 tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 200 len: 1310 microversion: 2.1 time: 0.103983 May 19 13:59:35.454113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 351/693] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:35 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 1310 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:36.270507 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-efc58845-74f8-4bf7-801e-7693e6454b7a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1189872962"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:36.271161 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-efc58845-74f8-4bf7-801e-7693e6454b7a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:36.278070 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-efc58845-74f8-4bf7-801e-7693e6454b7a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:36.278517 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-efc58845-74f8-4bf7-801e-7693e6454b7a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:36.279303 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-efc58845-74f8-4bf7-801e-7693e6454b7a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:36.279738 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-efc58845-74f8-4bf7-801e-7693e6454b7a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:36.409315 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.network.security_group_api [None req-efc58845-74f8-4bf7-801e-7693e6454b7a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Removing security group 763fc0df-a0f0-43b9-a4cb-14c8e8cdd173 from port e9f3edc9-7c52-4610-9122-024284dd285b May 19 13:59:36.469833 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:36.470488 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] [instance: 2b0a5331-be2a-4c5b-80ac-6be7220f2516] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:36.477318 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:36.477782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:36.478562 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:36.479041 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:36.492226 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] HTTP exception thrown: Instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 could not be found. May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Request method failure captured: May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 HTTP/1.1 May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwR8hzgIQIvgXeEM5L2dMhVxvBFzRTgSVN6ic_FVvk5L-iPskc47LcpgVydeVUCvM0x7XfiA91dw9McFpEV16_PqPrAs7WDyu_9PxCp_2nJTUBv4popy6qF1P2_PDF8M1xIqMvUfN4G_EW0aX6yCiNb6CHv7jCtLFHzhW1M2f-GVSU May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:59:36.493943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/28027af4cc0c4ca99035e48aa6237805"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/28027af4cc0c4ca99035e48aa6237805"}]}] May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 28027af4cc0c4ca99035e48aa6237805 May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2098748740 May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 698ccea06fb24beea18c679d53f907a6 May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2098748740-project May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 could not be found. May 19 13:59:36.495507 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '2b0a5331-be2a-4c5b-80ac-6be7220f2516'} May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 could not be found. May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:59:36.496968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 could not be found. May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 could not be found. May 19 13:59:36.498477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:36.499763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] Returning 404 to user: Instance 2b0a5331-be2a-4c5b-80ac-6be7220f2516 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:59:36.499763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-44df8d95-542f-420f-98d4-2611ab55843f tempest-ServerRescueNegativeTestJSON-2098748740 tempest-ServerRescueNegativeTestJSON-2098748740-project] 10.222.0.52 "GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516" status: 404 len: 111 microversion: 2.1 time: 0.029470 May 19 13:59:36.499763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 352/694] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:36 2022] GET /compute/v2.1/servers/2b0a5331-be2a-4c5b-80ac-6be7220f2516 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 13:59:36.804630 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-efc58845-74f8-4bf7-801e-7693e6454b7a tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "POST /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/action" status: 202 len: 0 microversion: 2.1 time: 0.538339 May 19 13:59:36.806259 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 343/695] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 13:59:36 2022] POST /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:59:36.881993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-4300013b-154e-4cb8-bec7-d85e83083a7a req-f40358aa-3f95-4b20-a0fc-f5a22ceb60aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282f0dfe-fd26-4a02-91e0-69716322d7d5", "tag": "e9f3edc9-7c52-4610-9122-024284dd285b"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:36.899327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-4300013b-154e-4cb8-bec7-d85e83083a7a req-f40358aa-3f95-4b20-a0fc-f5a22ceb60aa service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:36.899918 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-4300013b-154e-4cb8-bec7-d85e83083a7a req-f40358aa-3f95-4b20-a0fc-f5a22ceb60aa service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:36.935903 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-4300013b-154e-4cb8-bec7-d85e83083a7a req-f40358aa-3f95-4b20-a0fc-f5a22ceb60aa service nova] Creating event network-changed:e9f3edc9-7c52-4610-9122-024284dd285b for instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 on hv-cinder-78481 May 19 13:59:36.944721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-4300013b-154e-4cb8-bec7-d85e83083a7a req-f40358aa-3f95-4b20-a0fc-f5a22ceb60aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065776 May 19 13:59:36.950310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 353/696] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:38.642649 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cd5236ee-3540-4180-b829-8e06a7a75b79 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:38.643230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cd5236ee-3540-4180-b829-8e06a7a75b79 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:38.658421 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd5236ee-3540-4180-b829-8e06a7a75b79 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:38.658788 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd5236ee-3540-4180-b829-8e06a7a75b79 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:38.659594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd5236ee-3540-4180-b829-8e06a7a75b79 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:38.660032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd5236ee-3540-4180-b829-8e06a7a75b79 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:38.771294 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-cd5236ee-3540-4180-b829-8e06a7a75b79 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lazy-loading 'services' on Instance uuid 282f0dfe-fd26-4a02-91e0-69716322d7d5 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:59:38.871775 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cd5236ee-3540-4180-b829-8e06a7a75b79 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "DELETE /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments/a5ee2720-6939-4cba-80d1-d6aad87bd3b6" status: 202 len: 0 microversion: 2.1 time: 0.233090 May 19 13:59:38.874173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 344/697] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 13:59:38 2022] DELETE /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments/a5ee2720-6939-4cba-80d1-d6aad87bd3b6 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:59:38.884196 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a5a3ef37-e56f-4e2e-886d-c6d8d23b0caa tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:38.886122 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a5a3ef37-e56f-4e2e-886d-c6d8d23b0caa tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:38.895677 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5a3ef37-e56f-4e2e-886d-c6d8d23b0caa tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:38.896920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5a3ef37-e56f-4e2e-886d-c6d8d23b0caa tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:38.898116 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5a3ef37-e56f-4e2e-886d-c6d8d23b0caa tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:38.898719 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a5a3ef37-e56f-4e2e-886d-c6d8d23b0caa tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:38.968260 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-bc470ae8-86e9-4d1f-b884-a4f051fd6a8f req-a3ea50cc-7146-4ea1-ad3f-f127601969d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282f0dfe-fd26-4a02-91e0-69716322d7d5", "tag": "e9f3edc9-7c52-4610-9122-024284dd285b"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:38.976891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a5a3ef37-e56f-4e2e-886d-c6d8d23b0caa tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098538 May 19 13:59:38.983425 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 354/698] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:59:38 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:38.983634 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-bc470ae8-86e9-4d1f-b884-a4f051fd6a8f req-a3ea50cc-7146-4ea1-ad3f-f127601969d0 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:38.984082 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-bc470ae8-86e9-4d1f-b884-a4f051fd6a8f req-a3ea50cc-7146-4ea1-ad3f-f127601969d0 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:38.998250 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-bc470ae8-86e9-4d1f-b884-a4f051fd6a8f req-a3ea50cc-7146-4ea1-ad3f-f127601969d0 service nova] Creating event network-changed:e9f3edc9-7c52-4610-9122-024284dd285b for instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 on hv-cinder-78481 May 19 13:59:39.022896 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-bc470ae8-86e9-4d1f-b884-a4f051fd6a8f req-a3ea50cc-7146-4ea1-ad3f-f127601969d0 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059019 May 19 13:59:39.024732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 345/699] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:39.988887 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2dd1ba8e-7e60-46bd-b17d-943b6b13c5e7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:39.990016 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2dd1ba8e-7e60-46bd-b17d-943b6b13c5e7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:40.001350 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2dd1ba8e-7e60-46bd-b17d-943b6b13c5e7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:40.002811 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2dd1ba8e-7e60-46bd-b17d-943b6b13c5e7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:40.003879 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2dd1ba8e-7e60-46bd-b17d-943b6b13c5e7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:40.007249 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2dd1ba8e-7e60-46bd-b17d-943b6b13c5e7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:40.053165 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2dd1ba8e-7e60-46bd-b17d-943b6b13c5e7 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068416 May 19 13:59:40.053734 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 355/700] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:59:39 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:59:40.066829 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:40.067522 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:40.075305 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:40.076580 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:40.077378 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:40.077820 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:40.169535 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] HTTP exception thrown: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 is not attached to volume a5ee2720-6939-4cba-80d1-d6aad87bd3b6 May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Request method failure captured: May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments/a5ee2720-6939-4cba-80d1-d6aad87bd3b6 HTTP/1.1 May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkyVyJRXEYincq9_2RTnyQPe0OJMeIVPkMK4mUlbwcUMgKki3PrKaVoWC5j-tOjpNVRReNKujeuKzceZ4-YNaQ3gCvbcdN3iqLlTzTOdI1JViGFtc8ofPZv9IRSv_TZRDVZ3yVCwdcu1fxZkVvFmnZT9PUS8_YMyrAL1CkuOEJQW7k0 May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: a51cbae6cb494a2fac656e416fe868c2 May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-TestMinimumBasicScenario-1300065720 May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:59:40.181019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a51cbae6cb494a2fac656e416fe868c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a51cbae6cb494a2fac656e416fe868c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a51cbae6cb494a2fac656e416fe868c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a51cbae6cb494a2fac656e416fe868c2"}]}] May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-TestMinimumBasicScenario-1300065720 May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: a51cbae6cb494a2fac656e416fe868c2 May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1300065720 May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-TestMinimumBasicScenario-1300065720-project May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: a1274435c6774faa9eeeac6726b52b47 May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-TestMinimumBasicScenario-1300065720-project May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 13:59:40.182670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 is not attached to volume a5ee2720-6939-4cba-80d1-d6aad87bd3b6 May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'server_id': '282f0dfe-fd26-4a02-91e0-69716322d7d5', 'id': 'a5ee2720-6939-4cba-80d1-d6aad87bd3b6'} May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a5ee2720-6939-4cba-80d1-d6aad87bd3b6. May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:59:40.183695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 is not attached to volume a5ee2720-6939-4cba-80d1-d6aad87bd3b6 May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 is not attached to volume a5ee2720-6939-4cba-80d1-d6aad87bd3b6 May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:40.185113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Returning 404 to user: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 is not attached to volume a5ee2720-6939-4cba-80d1-d6aad87bd3b6 {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:59:40.186023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f1584a21-3afc-4577-aedf-7c45798dddd4 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "DELETE /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments/a5ee2720-6939-4cba-80d1-d6aad87bd3b6" status: 404 len: 154 microversion: 2.1 time: 0.121792 May 19 13:59:40.186023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 346/701] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 13:59:40 2022] DELETE /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5/os-volume_attachments/a5ee2720-6939-4cba-80d1-d6aad87bd3b6 => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:59:41.306678 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7374ead6-dc89-499e-ab19-83d735ba5ed5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:41.307182 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7374ead6-dc89-499e-ab19-83d735ba5ed5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:41.313132 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7374ead6-dc89-499e-ab19-83d735ba5ed5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:41.313697 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7374ead6-dc89-499e-ab19-83d735ba5ed5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:41.314341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7374ead6-dc89-499e-ab19-83d735ba5ed5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:41.314775 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7374ead6-dc89-499e-ab19-83d735ba5ed5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:41.339492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7374ead6-dc89-499e-ab19-83d735ba5ed5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/ips" status: 200 len: 150 microversion: 2.1 time: 0.269454 May 19 13:59:41.345308 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 356/702] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 13:59:41 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/ips => generated 150 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:41.359939 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1367c407-a5c7-4e64-a78a-9f27d06c8ec3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:41.360515 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1367c407-a5c7-4e64-a78a-9f27d06c8ec3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:41.367669 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1367c407-a5c7-4e64-a78a-9f27d06c8ec3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:41.368873 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1367c407-a5c7-4e64-a78a-9f27d06c8ec3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:41.369647 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1367c407-a5c7-4e64-a78a-9f27d06c8ec3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:41.370081 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1367c407-a5c7-4e64-a78a-9f27d06c8ec3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:41.400736 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1367c407-a5c7-4e64-a78a-9f27d06c8ec3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:59:41.505162 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1367c407-a5c7-4e64-a78a-9f27d06c8ec3 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "DELETE /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 204 len: 0 microversion: 2.1 time: 0.148587 May 19 13:59:41.506077 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 347/703] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:59:41 2022] DELETE /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:59:41.514455 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-84305a99-a497-4eb8-97bd-e27df27917f2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:41.515551 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-84305a99-a497-4eb8-97bd-e27df27917f2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:41.521923 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-84305a99-a497-4eb8-97bd-e27df27917f2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:41.522564 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-84305a99-a497-4eb8-97bd-e27df27917f2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:41.523526 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-84305a99-a497-4eb8-97bd-e27df27917f2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:41.524647 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-84305a99-a497-4eb8-97bd-e27df27917f2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:41.702604 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-84305a99-a497-4eb8-97bd-e27df27917f2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:41.711245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-84305a99-a497-4eb8-97bd-e27df27917f2 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1553 microversion: 2.1 time: 0.200450 May 19 13:59:41.711921 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 357/704] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:41 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1553 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:42.717408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f37df8c5-d539-4f2a-a90c-a72a3d895759 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16a1ec8b-397e-48be-beb2-21b3ea649d51"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:42.719286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f37df8c5-d539-4f2a-a90c-a72a3d895759 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:42.729915 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f5601b82-dab1-4944-8f63-61efbbfd4595 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:42.730646 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f5601b82-dab1-4944-8f63-61efbbfd4595 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:42.736118 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f37df8c5-d539-4f2a-a90c-a72a3d895759 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:42.736781 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f37df8c5-d539-4f2a-a90c-a72a3d895759 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:42.737968 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f37df8c5-d539-4f2a-a90c-a72a3d895759 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:42.738567 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f37df8c5-d539-4f2a-a90c-a72a3d895759 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:42.739433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5601b82-dab1-4944-8f63-61efbbfd4595 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:42.740004 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5601b82-dab1-4944-8f63-61efbbfd4595 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:42.740897 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5601b82-dab1-4944-8f63-61efbbfd4595 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:42.741470 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5601b82-dab1-4944-8f63-61efbbfd4595 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:42.918331 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f5601b82-dab1-4944-8f63-61efbbfd4595 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:42.927737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f5601b82-dab1-4944-8f63-61efbbfd4595 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1553 microversion: 2.1 time: 0.202556 May 19 13:59:42.928667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 358/705] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:42 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1553 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:59:43.322416 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f37df8c5-d539-4f2a-a90c-a72a3d895759 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.609561 May 19 13:59:43.323079 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 348/706] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 13:59:42 2022] POST /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments => generated 194 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:59:43.945730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3d8a26df-d4f6-4b21-9068-f3767e61c8dd tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:43.946618 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3d8a26df-d4f6-4b21-9068-f3767e61c8dd tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:43.953871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3d8a26df-d4f6-4b21-9068-f3767e61c8dd tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:43.954343 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3d8a26df-d4f6-4b21-9068-f3767e61c8dd tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:43.955177 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3d8a26df-d4f6-4b21-9068-f3767e61c8dd tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:43.955801 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3d8a26df-d4f6-4b21-9068-f3767e61c8dd tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:44.062535 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-0cf0b650-670a-44c4-9d58-4de4bd2f1449 req-9a7e46fd-afcf-4eb8-84f5-df7dc10e62f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282f0dfe-fd26-4a02-91e0-69716322d7d5", "name": "network-vif-deleted", "tag": "e9f3edc9-7c52-4610-9122-024284dd285b"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:44.070835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3d8a26df-d4f6-4b21-9068-f3767e61c8dd tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:44.085210 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3d8a26df-d4f6-4b21-9068-f3767e61c8dd tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1511 microversion: 2.1 time: 0.143608 May 19 13:59:44.086137 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 359/707] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:43 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1511 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:44.088505 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-0cf0b650-670a-44c4-9d58-4de4bd2f1449 req-9a7e46fd-afcf-4eb8-84f5-df7dc10e62f1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:44.090059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-0cf0b650-670a-44c4-9d58-4de4bd2f1449 req-9a7e46fd-afcf-4eb8-84f5-df7dc10e62f1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:44.122072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-0cf0b650-670a-44c4-9d58-4de4bd2f1449 req-9a7e46fd-afcf-4eb8-84f5-df7dc10e62f1 service nova] Creating event network-vif-deleted:e9f3edc9-7c52-4610-9122-024284dd285b for instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 on hv-cinder-78481 May 19 13:59:44.135553 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-0cf0b650-670a-44c4-9d58-4de4bd2f1449 req-9a7e46fd-afcf-4eb8-84f5-df7dc10e62f1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083265 May 19 13:59:44.136764 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 349/708] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:45.105940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:45.107445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:45.136771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:45.154832 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:45.160712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:45.164076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:45.290146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:45.290905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:45.291455 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lazy-loading 'fault' on Instance uuid 282f0dfe-fd26-4a02-91e0-69716322d7d5 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:59:45.353516 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1274435c6774faa9eeeac6726b52b47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51cbae6cb494a2fac656e416fe868c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:45.366462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d264b4f8-c7a8-4f7e-a641-000a2cb5bd4c tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 200 len: 1348 microversion: 2.1 time: 0.267346 May 19 13:59:45.370938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 360/709] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:45 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 1348 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:45.715315 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16a1ec8b-397e-48be-beb2-21b3ea649d51"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:45.716583 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:45.723591 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:45.724312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:45.725280 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:45.725778 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:45.819908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Invalid volume: volume 16a1ec8b-397e-48be-beb2-21b3ea649d51 is already attached to instances: 0c2be2ac-8751-4467-9d51-1eee62e05dbe May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: POST /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments HTTP/1.1 May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 74 May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:59:45.821801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {"volumeAttachment": {"volumeId": "16a1ec8b-397e-48be-beb2-21b3ea649d51"}} May 19 13:59:45.823364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Invalid volume: volume 16a1ec8b-397e-48be-beb2-21b3ea649d51 is already attached to instances: 0c2be2ac-8751-4467-9d51-1eee62e05dbe May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'server_id': '0c2be2ac-8751-4467-9d51-1eee62e05dbe', 'body': {'volumeAttachment': {'volumeId': '16a1ec8b-397e-48be-beb2-21b3ea649d51'}}} May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 16a1ec8b-397e-48be-beb2-21b3ea649d51 is already attached to instances: 0c2be2ac-8751-4467-9d51-1eee62e05dbe May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:45.824208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 16a1ec8b-397e-48be-beb2-21b3ea649d51 is already attached to instances: 0c2be2ac-8751-4467-9d51-1eee62e05dbe May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:45.825581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:45.826993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:45.826993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:59:45.826993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:59:45.826993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 16a1ec8b-397e-48be-beb2-21b3ea649d51 is already attached to instances: 0c2be2ac-8751-4467-9d51-1eee62e05dbe May 19 13:59:45.826993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:45.826993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 400 to user: Invalid volume: volume 16a1ec8b-397e-48be-beb2-21b3ea649d51 is already attached to instances: 0c2be2ac-8751-4467-9d51-1eee62e05dbe {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:59:45.826993 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cd22dc5c-e102-4a5b-a8c6-41b1e638989d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115475 May 19 13:59:45.827690 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 350/710] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 13:59:45 2022] POST /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 13:59:45.906748 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b9286ddf-0f3f-4b60-b58f-819fdb5d248e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:45.907596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b9286ddf-0f3f-4b60-b58f-819fdb5d248e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:45.917113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b9286ddf-0f3f-4b60-b58f-819fdb5d248e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:45.917650 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b9286ddf-0f3f-4b60-b58f-819fdb5d248e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:45.918551 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b9286ddf-0f3f-4b60-b58f-819fdb5d248e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:45.919136 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b9286ddf-0f3f-4b60-b58f-819fdb5d248e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:46.017465 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-b9286ddf-0f3f-4b60-b58f-819fdb5d248e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lazy-loading 'services' on Instance uuid 0c2be2ac-8751-4467-9d51-1eee62e05dbe {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:59:46.142231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b9286ddf-0f3f-4b60-b58f-819fdb5d248e tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments/16a1ec8b-397e-48be-beb2-21b3ea649d51" status: 202 len: 0 microversion: 2.1 time: 0.239408 May 19 13:59:46.144942 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 361/711] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 13:59:45 2022] DELETE /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments/16a1ec8b-397e-48be-beb2-21b3ea649d51 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:59:46.153727 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b512d539-7823-4538-aeb2-a44a9e6a7ec4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:46.156368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b512d539-7823-4538-aeb2-a44a9e6a7ec4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:46.165020 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b512d539-7823-4538-aeb2-a44a9e6a7ec4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:46.165974 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b512d539-7823-4538-aeb2-a44a9e6a7ec4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:46.167035 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b512d539-7823-4538-aeb2-a44a9e6a7ec4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:46.167697 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b512d539-7823-4538-aeb2-a44a9e6a7ec4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:46.204544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b512d539-7823-4538-aeb2-a44a9e6a7ec4 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054947 May 19 13:59:46.205208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 351/712] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:59:46 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:59:46.363391 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6ea65a7d-71cc-43cf-bef8-30879b11d753 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'create', calling method: .version_select at 0x7f5de23b2940>, body: {"keypair": {"name": "tempest-keypair-826849720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbNKofKwUx7PWSj6fHbGJX001tCabxylZq/W+3LJAl6kSEbP6HoTRhqKzmO5friJDVX1uacxMt8HWOJPUA6+1taS8p7HOV8TcuyrRTfiO05sn7+VtSBLimwHqUa4msV4Q=="}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:46.378368 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-6ea65a7d-71cc-43cf-bef8-30879b11d753 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Getting quotas for project e14dac6dd56c4f93b65ad91673debf71. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:59:46.383275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-6ea65a7d-71cc-43cf-bef8-30879b11d753 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Getting quotas for user ab1b34a915464792b5d3b74956bc49a2 and project e14dac6dd56c4f93b65ad91673debf71. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:59:46.385437 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:46.386120 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] [instance: 282f0dfe-fd26-4a02-91e0-69716322d7d5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:46.395030 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:46.395488 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:46.396270 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:46.396704 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:46.411715 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] HTTP exception thrown: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 could not be found. May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Request method failure captured: May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 HTTP/1.1 May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkyVyJRXEYincq9_2RTnyQPe0OJMeIVPkMK4mUlbwcUMgKki3PrKaVoWC5j-tOjpNVRReNKujeuKzceZ4-YNaQ3gCvbcdN3iqLlTzTOdI1JViGFtc8ofPZv9IRSv_TZRDVZ3yVCwdcu1fxZkVvFmnZT9PUS8_YMyrAL1CkuOEJQW7k0 May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: a51cbae6cb494a2fac656e416fe868c2 May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-TestMinimumBasicScenario-1300065720 May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 13:59:46.413570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a51cbae6cb494a2fac656e416fe868c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a51cbae6cb494a2fac656e416fe868c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a51cbae6cb494a2fac656e416fe868c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a51cbae6cb494a2fac656e416fe868c2"}]}] May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-TestMinimumBasicScenario-1300065720 May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: a51cbae6cb494a2fac656e416fe868c2 May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1300065720 May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-TestMinimumBasicScenario-1300065720-project May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: a1274435c6774faa9eeeac6726b52b47 May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-TestMinimumBasicScenario-1300065720-project May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 could not be found. May 19 13:59:46.415665 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '282f0dfe-fd26-4a02-91e0-69716322d7d5'} May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 could not be found. May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:59:46.416494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 could not be found. May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 could not be found. May 19 13:59:46.417849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 13:59:46.419115 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Returning 404 to user: Instance 282f0dfe-fd26-4a02-91e0-69716322d7d5 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:59:46.419115 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-807b2144-fba0-409b-877b-15fd12f35650 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5" status: 404 len: 111 microversion: 2.1 time: 0.035413 May 19 13:59:46.419115 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 352/713] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:46 2022] GET /compute/v2.1/servers/282f0dfe-fd26-4a02-91e0-69716322d7d5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 13:59:46.424081 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6ea65a7d-71cc-43cf-bef8-30879b11d753 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180035 May 19 13:59:46.424778 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 362/714] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 13:59:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:46.425026 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-67904d27-f570-4a4b-9dd8-5a66078e4f76 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] Calling method '.version_select at 0x7f5de1cc0280>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:46.444814 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-67904d27-f570-4a4b-9dd8-5a66078e4f76 tempest-TestMinimumBasicScenario-1300065720 tempest-TestMinimumBasicScenario-1300065720-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1267529478" status: 202 len: 0 microversion: 2.1 time: 0.023758 May 19 13:59:46.447025 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 353/715] 10.222.0.52 () {58 vars in 1271 bytes} [Thu May 19 13:59:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1267529478 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 13:59:47.217385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2644db37-2804-4cb9-bde8-c995446d9130 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:47.218455 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2644db37-2804-4cb9-bde8-c995446d9130 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:47.237363 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2644db37-2804-4cb9-bde8-c995446d9130 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:47.238125 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2644db37-2804-4cb9-bde8-c995446d9130 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:47.239074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2644db37-2804-4cb9-bde8-c995446d9130 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:47.239661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2644db37-2804-4cb9-bde8-c995446d9130 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:47.298562 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2644db37-2804-4cb9-bde8-c995446d9130 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085147 May 19 13:59:47.299928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 363/716] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 13:59:47 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 13:59:47.406797 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c2674322-c2f7-49b7-bf01-f3ebc6da1c25 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:47.407823 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c2674322-c2f7-49b7-bf01-f3ebc6da1c25 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:47.416196 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c2674322-c2f7-49b7-bf01-f3ebc6da1c25 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:47.416647 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c2674322-c2f7-49b7-bf01-f3ebc6da1c25 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:47.417669 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c2674322-c2f7-49b7-bf01-f3ebc6da1c25 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:47.419462 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c2674322-c2f7-49b7-bf01-f3ebc6da1c25 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:47.449636 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:47.464514 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c2674322-c2f7-49b7-bf01-f3ebc6da1c25 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 13:59:47.578910 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c2674322-c2f7-49b7-bf01-f3ebc6da1c25 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 204 len: 0 microversion: 2.1 time: 0.177639 May 19 13:59:47.579710 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 354/717] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 13:59:47 2022] DELETE /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 13:59:47.591506 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-77268d2b-359e-4e7d-b53f-da0bf9ed57e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:47.592670 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-77268d2b-359e-4e7d-b53f-da0bf9ed57e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:47.598954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-77268d2b-359e-4e7d-b53f-da0bf9ed57e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:47.599825 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-77268d2b-359e-4e7d-b53f-da0bf9ed57e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:47.600856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-77268d2b-359e-4e7d-b53f-da0bf9ed57e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:47.601398 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-77268d2b-359e-4e7d-b53f-da0bf9ed57e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:47.882623 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-77268d2b-359e-4e7d-b53f-da0bf9ed57e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:47.892310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-77268d2b-359e-4e7d-b53f-da0bf9ed57e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1683 microversion: 2.1 time: 0.307910 May 19 13:59:47.892885 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 364/718] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:47 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1683 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:59:48.012519 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1301846490", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f8bcd1c-fe6c-418c-88b6-9ed5b3ff968d"}], "security_groups": [{"name": "tempest-securitygroup--941393568"}], "key_name": "tempest-keypair-826849720", "user_data": "}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:48.202087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] validate_networks() for [('1f8bcd1c-fe6c-418c-88b6-9ed5b3ff968d', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:59:48.909614 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f3a830e8-ec5c-44be-88e8-ab16b209ba0d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:48.910592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f3a830e8-ec5c-44be-88e8-ab16b209ba0d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:48.917951 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f3a830e8-ec5c-44be-88e8-ab16b209ba0d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:48.918673 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f3a830e8-ec5c-44be-88e8-ab16b209ba0d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:48.920611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f3a830e8-ec5c-44be-88e8-ab16b209ba0d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:48.921376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f3a830e8-ec5c-44be-88e8-ab16b209ba0d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:48.927330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:49.189664 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:59:49.190733 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:59:49.192742 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:59:49.193605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:59:49.194323 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:59:49.212190 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:49.212751 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:49.213816 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:49.214364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:49.233689 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f3a830e8-ec5c-44be-88e8-ab16b209ba0d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:49.246465 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Getting quotas for project e14dac6dd56c4f93b65ad91673debf71. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:59:49.248193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f3a830e8-ec5c-44be-88e8-ab16b209ba0d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1683 microversion: 2.1 time: 0.342426 May 19 13:59:49.248782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 365/719] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:48 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1683 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:59:49.282352 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Getting quotas for user ab1b34a915464792b5d3b74956bc49a2 and project e14dac6dd56c4f93b65ad91673debf71. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:59:49.298902 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:59:49.302357 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:59:49.369387 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cf3fceb2-596a-49bd-ab0e-f3578ae6f4a9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.361381 May 19 13:59:49.370732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 355/720] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:59:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1364 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 13:59:49.381342 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fcf5d7d1-49f4-4199-942b-135814ef9a28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:49.382034 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-fcf5d7d1-49f4-4199-942b-135814ef9a28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:49.489383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fcf5d7d1-49f4-4199-942b-135814ef9a28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:49.497212 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-fcf5d7d1-49f4-4199-942b-135814ef9a28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1237 microversion: 2.1 time: 0.120024 May 19 13:59:49.498444 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 366/721] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:49 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1237 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:50.270026 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-de8abee4-554d-4f83-adb2-7ef328b12113 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:50.271348 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-de8abee4-554d-4f83-adb2-7ef328b12113 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:50.281709 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de8abee4-554d-4f83-adb2-7ef328b12113 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:50.282439 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de8abee4-554d-4f83-adb2-7ef328b12113 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:50.283457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de8abee4-554d-4f83-adb2-7ef328b12113 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:50.284050 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de8abee4-554d-4f83-adb2-7ef328b12113 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:50.514489 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c5bcc571-460a-41e3-94be-ec9807aca350 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:50.516354 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c5bcc571-460a-41e3-94be-ec9807aca350 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:50.524466 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5bcc571-460a-41e3-94be-ec9807aca350 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:50.525202 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5bcc571-460a-41e3-94be-ec9807aca350 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:50.526156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5bcc571-460a-41e3-94be-ec9807aca350 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:50.526757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5bcc571-460a-41e3-94be-ec9807aca350 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:50.666550 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-de8abee4-554d-4f83-adb2-7ef328b12113 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:50.676364 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-de8abee4-554d-4f83-adb2-7ef328b12113 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1683 microversion: 2.1 time: 0.410267 May 19 13:59:50.681970 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c5bcc571-460a-41e3-94be-ec9807aca350 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:50.687660 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 356/722] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:50 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1683 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:50.700422 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c5bcc571-460a-41e3-94be-ec9807aca350 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1289 microversion: 2.1 time: 0.190463 May 19 13:59:50.702482 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 367/723] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:50 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1289 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:59:51.261682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-61dfc69b-3b87-4287-9052-f4cfcbd805d0 req-ecd64d31-f548-4247-b7ab-89530444d084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c2be2ac-8751-4467-9d51-1eee62e05dbe", "name": "network-vif-deleted", "tag": "0034a6da-8683-41b5-98a9-fbbf91e91c4d"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:51.270724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-61dfc69b-3b87-4287-9052-f4cfcbd805d0 req-ecd64d31-f548-4247-b7ab-89530444d084 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:51.271821 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-61dfc69b-3b87-4287-9052-f4cfcbd805d0 req-ecd64d31-f548-4247-b7ab-89530444d084 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:51.284860 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-61dfc69b-3b87-4287-9052-f4cfcbd805d0 req-ecd64d31-f548-4247-b7ab-89530444d084 service nova] Creating event network-vif-deleted:0034a6da-8683-41b5-98a9-fbbf91e91c4d for instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe on hv-cinder-78481 May 19 13:59:51.290243 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-61dfc69b-3b87-4287-9052-f4cfcbd805d0 req-ecd64d31-f548-4247-b7ab-89530444d084 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169875 May 19 13:59:51.291286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 357/724] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:59:51.698760 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:51.700575 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:51.709267 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:51.710026 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:51.710982 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:51.712209 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:51.720702 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-16ceddb7-f3aa-4dbc-bcfb-c112d9c44e2f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:51.721744 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-16ceddb7-f3aa-4dbc-bcfb-c112d9c44e2f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:51.732731 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16ceddb7-f3aa-4dbc-bcfb-c112d9c44e2f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:51.735635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16ceddb7-f3aa-4dbc-bcfb-c112d9c44e2f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:51.736916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16ceddb7-f3aa-4dbc-bcfb-c112d9c44e2f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:51.737635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16ceddb7-f3aa-4dbc-bcfb-c112d9c44e2f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:51.766519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:51.767275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:51.767891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lazy-loading 'fault' on Instance uuid 0c2be2ac-8751-4467-9d51-1eee62e05dbe {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 13:59:51.821787 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:51.832196 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f5dd18d1-92be-48a8-a4bf-601ac5875db0 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 200 len: 1332 microversion: 2.1 time: 0.140077 May 19 13:59:51.835593 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 368/725] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:51 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 1332 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:51.861013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-16ceddb7-f3aa-4dbc-bcfb-c112d9c44e2f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:51.871566 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-16ceddb7-f3aa-4dbc-bcfb-c112d9c44e2f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1295 microversion: 2.1 time: 0.155846 May 19 13:59:51.872429 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 358/726] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:51 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1295 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:52.854638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:52.855940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:52.868471 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:52.870527 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:52.871614 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:52.872216 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:52.889234 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 13:59:52.889841 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cf68ede3-9f89-4833-acba-11db5a5e208e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:52.890563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cf68ede3-9f89-4833-acba-11db5a5e208e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe HTTP/1.1 May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 13:59:52.891907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 13:59:52.893433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '0c2be2ac-8751-4467-9d51-1eee62e05dbe'} May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 13:59:52.894245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 13:59:52.895572 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 13:59:52.897703 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 13:59:52.899335 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-93455acc-381b-4dcf-8f25-7e9aa8cef6d5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 404 len: 111 microversion: 2.1 time: 0.050205 May 19 13:59:52.900421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 369/727] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:52 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 13:59:52.904271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf68ede3-9f89-4833-acba-11db5a5e208e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:52.907955 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf68ede3-9f89-4833-acba-11db5a5e208e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:52.910419 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf68ede3-9f89-4833-acba-11db5a5e208e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:52.911205 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf68ede3-9f89-4833-acba-11db5a5e208e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:52.916132 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c79f83ca-a1bf-40ee-8c55-ed3cc5a0b3c8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '.version_select at 0x7f5de23f3dc0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:52.951225 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c79f83ca-a1bf-40ee-8c55-ed3cc5a0b3c8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550151094" status: 202 len: 0 microversion: 2.1 time: 0.045363 May 19 13:59:52.955080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 370/728] 10.222.0.52 () {58 vars in 1220 bytes} [Thu May 19 13:59:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550151094 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 13:59:53.521490 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cf68ede3-9f89-4833-acba-11db5a5e208e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:53.533488 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cf68ede3-9f89-4833-acba-11db5a5e208e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1362 microversion: 2.1 time: 0.647730 May 19 13:59:53.544355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 359/729] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:52 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1362 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 13:59:54.109988 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e3b0d06a-4999-4bb0-ab8f-92b8a83a2803 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: .version_select at 0x7f5de1cc0040>, body: {"keypair": {"name": "tempest-keypair-1493176811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTQ3gwrYZdifjU8LfQSwVGOZVkK4jHjBuvB5CnuDu4qQlqTjF+t30PnKYwLGU8V1MM66Bm59cGBLk2FAA86V6m4pmnCGC1xxH4qL4JmjjlMppPgYhXX+pv5GAX21cjasQ=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:54.126998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-e3b0d06a-4999-4bb0-ab8f-92b8a83a2803 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for project 89b4336043d5446b922432a2f43af17a. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:59:54.131996 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-e3b0d06a-4999-4bb0-ab8f-92b8a83a2803 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for user 0cc3e0105f2a472092423852b1f39979 and project 89b4336043d5446b922432a2f43af17a. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:59:54.138051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-ade81232-bcca-4649-9530-ef61e4faf731 req-69a3cc3f-435e-4e75-a0e9-664c1249ddda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5", "tag": "a2e726ea-bd7a-4b38-921c-644a1035c3fb"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:54.150003 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-ade81232-bcca-4649-9530-ef61e4faf731 req-69a3cc3f-435e-4e75-a0e9-664c1249ddda service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:54.150786 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-ade81232-bcca-4649-9530-ef61e4faf731 req-69a3cc3f-435e-4e75-a0e9-664c1249ddda service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:54.159692 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e3b0d06a-4999-4bb0-ab8f-92b8a83a2803 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053583 May 19 13:59:54.160882 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 360/730] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 13:59:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 13:59:54.164222 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-ade81232-bcca-4649-9530-ef61e4faf731 req-69a3cc3f-435e-4e75-a0e9-664c1249ddda service nova] Creating event network-changed:a2e726ea-bd7a-4b38-921c-644a1035c3fb for instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 on hv-cinder-78481 May 19 13:59:54.181479 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-ade81232-bcca-4649-9530-ef61e4faf731 req-69a3cc3f-435e-4e75-a0e9-664c1249ddda service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148907 May 19 13:59:54.183811 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 371/731] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:54.551806 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b52a8c05-71bc-42c1-a152-912daedd37db tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:54.552507 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b52a8c05-71bc-42c1-a152-912daedd37db tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:54.558565 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b52a8c05-71bc-42c1-a152-912daedd37db tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:54.559126 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b52a8c05-71bc-42c1-a152-912daedd37db tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:54.559885 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b52a8c05-71bc-42c1-a152-912daedd37db tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:54.560316 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b52a8c05-71bc-42c1-a152-912daedd37db tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:54.692727 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b52a8c05-71bc-42c1-a152-912daedd37db tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:54.702339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b52a8c05-71bc-42c1-a152-912daedd37db tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1362 microversion: 2.1 time: 0.154219 May 19 13:59:54.702992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 361/732] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:54 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:55.723164 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-32f518a1-b0b5-4e2a-b888-15e5ad15b387 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:55.723164 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-32f518a1-b0b5-4e2a-b888-15e5ad15b387 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:55.736856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-32f518a1-b0b5-4e2a-b888-15e5ad15b387 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:55.737319 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-32f518a1-b0b5-4e2a-b888-15e5ad15b387 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:55.738111 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-32f518a1-b0b5-4e2a-b888-15e5ad15b387 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:55.738555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-32f518a1-b0b5-4e2a-b888-15e5ad15b387 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:55.833269 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-769622480", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08206db8-8e78-4412-8a62-0db97bb617cf"}], "security_groups": [{"name": "tempest-securitygroup--789902342"}], "key_name": "tempest-keypair-1493176811", "user_data": "}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:55.900498 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-32f518a1-b0b5-4e2a-b888-15e5ad15b387 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:55.910694 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-32f518a1-b0b5-4e2a-b888-15e5ad15b387 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1362 microversion: 2.1 time: 0.195463 May 19 13:59:55.911880 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 372/733] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:55 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:55.977603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] validate_networks() for [('08206db8-8e78-4412-8a62-0db97bb617cf', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 13:59:56.399601 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 13:59:56.400473 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 13:59:56.401162 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 13:59:56.402446 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 13:59:56.403126 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 13:59:56.412294 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:56.412836 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:56.413717 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:56.414853 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:56.432246 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for project 89b4336043d5446b922432a2f43af17a. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 13:59:56.436331 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Getting quotas for user 0cc3e0105f2a472092423852b1f39979 and project 89b4336043d5446b922432a2f43af17a. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 13:59:56.447291 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 13:59:56.449635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 13:59:56.461781 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 13:59:56.499719 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e26fda86-ae6c-48c1-805d-45b11502eea5 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.670830 May 19 13:59:56.500469 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 362/734] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 13:59:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 13:59:56.510372 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2412cf71-35ba-4613-a975-3526a608813c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:56.511163 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2412cf71-35ba-4613-a975-3526a608813c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:56.585843 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2412cf71-35ba-4613-a975-3526a608813c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:56.594584 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2412cf71-35ba-4613-a975-3526a608813c tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1241 microversion: 2.1 time: 0.087922 May 19 13:59:56.595193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 373/735] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:56 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:56.929143 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-564c154a-2ced-454e-9e46-b7ed30b9d582 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:56.930397 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-564c154a-2ced-454e-9e46-b7ed30b9d582 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:56.937531 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-564c154a-2ced-454e-9e46-b7ed30b9d582 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:56.937982 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-564c154a-2ced-454e-9e46-b7ed30b9d582 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:56.938764 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-564c154a-2ced-454e-9e46-b7ed30b9d582 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:56.939262 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-564c154a-2ced-454e-9e46-b7ed30b9d582 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:57.120515 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-564c154a-2ced-454e-9e46-b7ed30b9d582 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:57.128876 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-564c154a-2ced-454e-9e46-b7ed30b9d582 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1362 microversion: 2.1 time: 0.204019 May 19 13:59:57.144702 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 363/736] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:56 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:57.612666 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-630f4d2b-ea10-4cc9-ac9a-af390eb35a72 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:57.614290 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-630f4d2b-ea10-4cc9-ac9a-af390eb35a72 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:57.630720 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-630f4d2b-ea10-4cc9-ac9a-af390eb35a72 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:57.631424 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-630f4d2b-ea10-4cc9-ac9a-af390eb35a72 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:57.632991 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-630f4d2b-ea10-4cc9-ac9a-af390eb35a72 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:57.633508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-630f4d2b-ea10-4cc9-ac9a-af390eb35a72 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:57.750626 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-630f4d2b-ea10-4cc9-ac9a-af390eb35a72 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:57.761987 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-630f4d2b-ea10-4cc9-ac9a-af390eb35a72 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1301 microversion: 2.1 time: 0.153505 May 19 13:59:57.766184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 374/737] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:57 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1301 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:58.147343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-28f18cdd-dd0e-437e-9d6b-65e79bfb455c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:58.147996 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-28f18cdd-dd0e-437e-9d6b-65e79bfb455c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:58.155758 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-28f18cdd-dd0e-437e-9d6b-65e79bfb455c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:58.156218 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-28f18cdd-dd0e-437e-9d6b-65e79bfb455c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:58.156991 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-28f18cdd-dd0e-437e-9d6b-65e79bfb455c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:58.157430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-28f18cdd-dd0e-437e-9d6b-65e79bfb455c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:58.362775 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-28f18cdd-dd0e-437e-9d6b-65e79bfb455c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:58.371497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-28f18cdd-dd0e-437e-9d6b-65e79bfb455c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1362 microversion: 2.1 time: 0.227899 May 19 13:59:58.372246 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 364/738] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:58 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:58.784616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-401c03af-e06e-49c8-8699-f09e31e93e95 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:58.785993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-401c03af-e06e-49c8-8699-f09e31e93e95 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:58.794638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-401c03af-e06e-49c8-8699-f09e31e93e95 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:58.795467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-401c03af-e06e-49c8-8699-f09e31e93e95 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:58.796866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-401c03af-e06e-49c8-8699-f09e31e93e95 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:58.797882 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-401c03af-e06e-49c8-8699-f09e31e93e95 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:58.962995 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-401c03af-e06e-49c8-8699-f09e31e93e95 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:58.973893 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-401c03af-e06e-49c8-8699-f09e31e93e95 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1366 microversion: 2.1 time: 0.194718 May 19 13:59:58.974460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 375/739] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:58 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:59.389506 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-49c8748f-595b-4425-9535-76a9ee8d97b6 req-5bd99f86-3881-4c3d-b023-eafd24461fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e497045-70f8-4a86-9e3f-e1ecf7ac607a", "tag": "218713eb-c739-4649-b32f-d91de1913518"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 13:59:59.399266 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-57b96916-1b42-4449-8a24-508e9c818a3e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:59.399981 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-57b96916-1b42-4449-8a24-508e9c818a3e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:59.405685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-49c8748f-595b-4425-9535-76a9ee8d97b6 req-5bd99f86-3881-4c3d-b023-eafd24461fe8 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:59.406535 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-49c8748f-595b-4425-9535-76a9ee8d97b6 req-5bd99f86-3881-4c3d-b023-eafd24461fe8 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:59.413814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-57b96916-1b42-4449-8a24-508e9c818a3e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:59.414281 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-57b96916-1b42-4449-8a24-508e9c818a3e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:59.415200 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-57b96916-1b42-4449-8a24-508e9c818a3e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:59.418217 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-57b96916-1b42-4449-8a24-508e9c818a3e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 13:59:59.446720 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-49c8748f-595b-4425-9535-76a9ee8d97b6 req-5bd99f86-3881-4c3d-b023-eafd24461fe8 service nova] Creating event network-changed:218713eb-c739-4649-b32f-d91de1913518 for instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a on hv-cinder-78481 May 19 13:59:59.456459 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-49c8748f-595b-4425-9535-76a9ee8d97b6 req-5bd99f86-3881-4c3d-b023-eafd24461fe8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075035 May 19 13:59:59.457247 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 365/740] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 13:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 13:59:59.632430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-57b96916-1b42-4449-8a24-508e9c818a3e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 13:59:59.641089 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-57b96916-1b42-4449-8a24-508e9c818a3e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1362 microversion: 2.1 time: 0.252429 May 19 13:59:59.651156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 376/741] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:59 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 13:59:59.991519 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-61a6c02f-b981-450f-b9d1-bb4f9677c832 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 13:59:59.992264 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-61a6c02f-b981-450f-b9d1-bb4f9677c832 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 13:59:59.998811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61a6c02f-b981-450f-b9d1-bb4f9677c832 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 13:59:59.999283 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61a6c02f-b981-450f-b9d1-bb4f9677c832 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:00.000036 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61a6c02f-b981-450f-b9d1-bb4f9677c832 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:00.000468 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61a6c02f-b981-450f-b9d1-bb4f9677c832 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:00.134189 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61a6c02f-b981-450f-b9d1-bb4f9677c832 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:00.141619 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-61a6c02f-b981-450f-b9d1-bb4f9677c832 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1366 microversion: 2.1 time: 0.154609 May 19 14:00:00.142178 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 366/742] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 13:59:59 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:00.659897 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-85eeeac7-1792-4d97-9d82-e1f8867ef6ab tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:00.660501 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-85eeeac7-1792-4d97-9d82-e1f8867ef6ab tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:00.668005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-85eeeac7-1792-4d97-9d82-e1f8867ef6ab tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:00.668698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-85eeeac7-1792-4d97-9d82-e1f8867ef6ab tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:00.669485 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-85eeeac7-1792-4d97-9d82-e1f8867ef6ab tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:00.669931 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-85eeeac7-1792-4d97-9d82-e1f8867ef6ab tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:00.691880 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-05f283b7-7777-4535-a3fc-7f2522f9a9fc req-d4e4185f-6b3b-446c-929c-4266cd212ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5", "name": "network-vif-plugged", "status": "completed", "tag": "a2e726ea-bd7a-4b38-921c-644a1035c3fb"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:00.701415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-05f283b7-7777-4535-a3fc-7f2522f9a9fc req-d4e4185f-6b3b-446c-929c-4266cd212ed8 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:00.702221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-05f283b7-7777-4535-a3fc-7f2522f9a9fc req-d4e4185f-6b3b-446c-929c-4266cd212ed8 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:00.714445 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-05f283b7-7777-4535-a3fc-7f2522f9a9fc req-d4e4185f-6b3b-446c-929c-4266cd212ed8 service nova] Creating event network-vif-plugged:a2e726ea-bd7a-4b38-921c-644a1035c3fb for instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 on hv-cinder-78481 May 19 14:00:00.719390 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-05f283b7-7777-4535-a3fc-7f2522f9a9fc req-d4e4185f-6b3b-446c-929c-4266cd212ed8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031402 May 19 14:00:00.720174 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 367/743] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:00:00.810780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-85eeeac7-1792-4d97-9d82-e1f8867ef6ab tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:00.818808 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-85eeeac7-1792-4d97-9d82-e1f8867ef6ab tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1362 microversion: 2.1 time: 0.162711 May 19 14:00:00.819627 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 377/744] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:00 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:01.159399 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-49eb94dc-cc05-4016-9e5b-5df0e2ff5572 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:01.160105 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-49eb94dc-cc05-4016-9e5b-5df0e2ff5572 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:01.166347 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-49eb94dc-cc05-4016-9e5b-5df0e2ff5572 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:01.166799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-49eb94dc-cc05-4016-9e5b-5df0e2ff5572 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:01.167594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-49eb94dc-cc05-4016-9e5b-5df0e2ff5572 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:01.168036 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-49eb94dc-cc05-4016-9e5b-5df0e2ff5572 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:01.298801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-49eb94dc-cc05-4016-9e5b-5df0e2ff5572 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:01.307016 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-49eb94dc-cc05-4016-9e5b-5df0e2ff5572 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1366 microversion: 2.1 time: 0.151788 May 19 14:00:01.307585 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 368/745] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:01 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:01.835869 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-382f6736-c06d-4c43-8e63-1113a44e76e0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:01.836504 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-382f6736-c06d-4c43-8e63-1113a44e76e0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:01.843002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-382f6736-c06d-4c43-8e63-1113a44e76e0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:01.843462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-382f6736-c06d-4c43-8e63-1113a44e76e0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:01.844232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-382f6736-c06d-4c43-8e63-1113a44e76e0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:01.844674 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-382f6736-c06d-4c43-8e63-1113a44e76e0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:01.973574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-382f6736-c06d-4c43-8e63-1113a44e76e0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:01.981062 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-382f6736-c06d-4c43-8e63-1113a44e76e0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1362 microversion: 2.1 time: 0.149133 May 19 14:00:01.981625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 378/746] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:01 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:02.324148 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-22fd30c4-6373-4a77-8b51-26ae4292eb66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:02.324792 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-22fd30c4-6373-4a77-8b51-26ae4292eb66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:02.331290 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-22fd30c4-6373-4a77-8b51-26ae4292eb66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:02.331740 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-22fd30c4-6373-4a77-8b51-26ae4292eb66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:02.332509 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-22fd30c4-6373-4a77-8b51-26ae4292eb66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:02.332948 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-22fd30c4-6373-4a77-8b51-26ae4292eb66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:02.467119 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-22fd30c4-6373-4a77-8b51-26ae4292eb66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:02.474944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-22fd30c4-6373-4a77-8b51-26ae4292eb66 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1366 microversion: 2.1 time: 0.155021 May 19 14:00:02.475557 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 369/747] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:02 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:02.998239 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-dde08e15-3819-43a1-85d5-0780e4f93e28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:02.998943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-dde08e15-3819-43a1-85d5-0780e4f93e28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:03.005418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dde08e15-3819-43a1-85d5-0780e4f93e28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:03.006123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dde08e15-3819-43a1-85d5-0780e4f93e28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:03.006903 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dde08e15-3819-43a1-85d5-0780e4f93e28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:03.007345 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-dde08e15-3819-43a1-85d5-0780e4f93e28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:03.139153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-dde08e15-3819-43a1-85d5-0780e4f93e28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:03.146515 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-dde08e15-3819-43a1-85d5-0780e4f93e28 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1548 microversion: 2.1 time: 0.152111 May 19 14:00:03.147199 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 379/748] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:02 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:03.163262 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-53d977be-c570-49b5-99ce-08f61375b379 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:03.163683 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-53d977be-c570-49b5-99ce-08f61375b379 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:03.170170 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-53d977be-c570-49b5-99ce-08f61375b379 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:03.170618 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-53d977be-c570-49b5-99ce-08f61375b379 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:03.171427 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-53d977be-c570-49b5-99ce-08f61375b379 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:03.171864 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-53d977be-c570-49b5-99ce-08f61375b379 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:03.252325 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-53d977be-c570-49b5-99ce-08f61375b379 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092904 May 19 14:00:03.252920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 370/749] 10.222.0.52 () {58 vars in 1274 bytes} [Thu May 19 14:00:03 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:03.491894 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-88aa0ea5-d57f-4707-a980-0a3bc1f074b6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:03.492775 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-88aa0ea5-d57f-4707-a980-0a3bc1f074b6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:03.499034 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-88aa0ea5-d57f-4707-a980-0a3bc1f074b6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:03.499502 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-88aa0ea5-d57f-4707-a980-0a3bc1f074b6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:03.500284 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-88aa0ea5-d57f-4707-a980-0a3bc1f074b6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:03.500731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-88aa0ea5-d57f-4707-a980-0a3bc1f074b6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:03.737622 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-88aa0ea5-d57f-4707-a980-0a3bc1f074b6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:03.745329 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-88aa0ea5-d57f-4707-a980-0a3bc1f074b6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1366 microversion: 2.1 time: 0.257293 May 19 14:00:03.745900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 380/750] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:03 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:04.468483 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-59d8ab22-f0f9-4693-b72a-1d4d97688aac req-c78ff00d-cbd0-4d44-b1eb-52d8f8cfb66b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5", "tag": "a2e726ea-bd7a-4b38-921c-644a1035c3fb"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:04.477081 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-59d8ab22-f0f9-4693-b72a-1d4d97688aac req-c78ff00d-cbd0-4d44-b1eb-52d8f8cfb66b service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:04.477519 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-59d8ab22-f0f9-4693-b72a-1d4d97688aac req-c78ff00d-cbd0-4d44-b1eb-52d8f8cfb66b service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:04.488401 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-59d8ab22-f0f9-4693-b72a-1d4d97688aac req-c78ff00d-cbd0-4d44-b1eb-52d8f8cfb66b service nova] Creating event network-changed:a2e726ea-bd7a-4b38-921c-644a1035c3fb for instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 on hv-cinder-78481 May 19 14:00:04.494725 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-59d8ab22-f0f9-4693-b72a-1d4d97688aac req-c78ff00d-cbd0-4d44-b1eb-52d8f8cfb66b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030405 May 19 14:00:04.495382 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 371/751] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:04.762854 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d557a329-5205-4892-8e31-7dbe62b07a75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:04.764912 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d557a329-5205-4892-8e31-7dbe62b07a75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:04.772341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d557a329-5205-4892-8e31-7dbe62b07a75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:04.773074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d557a329-5205-4892-8e31-7dbe62b07a75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:04.775223 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d557a329-5205-4892-8e31-7dbe62b07a75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:04.775899 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d557a329-5205-4892-8e31-7dbe62b07a75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:04.944999 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d557a329-5205-4892-8e31-7dbe62b07a75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:04.957399 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d557a329-5205-4892-8e31-7dbe62b07a75 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1366 microversion: 2.1 time: 0.199047 May 19 14:00:04.967958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 381/752] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:04 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:05.109701 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-96200c39-a8e9-4574-a705-063214099497 req-5149ecd4-95ba-426a-ad87-ce691912d5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e497045-70f8-4a86-9e3f-e1ecf7ac607a", "name": "network-vif-plugged", "status": "completed", "tag": "218713eb-c739-4649-b32f-d91de1913518"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:05.118458 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-96200c39-a8e9-4574-a705-063214099497 req-5149ecd4-95ba-426a-ad87-ce691912d5af service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:05.118919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-96200c39-a8e9-4574-a705-063214099497 req-5149ecd4-95ba-426a-ad87-ce691912d5af service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:05.130467 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-96200c39-a8e9-4574-a705-063214099497 req-5149ecd4-95ba-426a-ad87-ce691912d5af service nova] Creating event network-vif-plugged:218713eb-c739-4649-b32f-d91de1913518 for instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a on hv-cinder-78481 May 19 14:00:05.136657 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-96200c39-a8e9-4574-a705-063214099497 req-5149ecd4-95ba-426a-ad87-ce691912d5af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277010 May 19 14:00:05.137707 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 372/753] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:05.975488 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-43b8b554-36fe-4385-b394-7df6499e9730 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:05.976247 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-43b8b554-36fe-4385-b394-7df6499e9730 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:05.983541 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43b8b554-36fe-4385-b394-7df6499e9730 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:05.983988 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43b8b554-36fe-4385-b394-7df6499e9730 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:05.984744 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43b8b554-36fe-4385-b394-7df6499e9730 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:05.985177 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43b8b554-36fe-4385-b394-7df6499e9730 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:06.063097 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3de49d2a-d058-4b99-8699-970724fcd043 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:06.063686 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3de49d2a-d058-4b99-8699-970724fcd043 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:06.065887 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:06.073038 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3de49d2a-d058-4b99-8699-970724fcd043 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:06.073521 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3de49d2a-d058-4b99-8699-970724fcd043 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:06.074306 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3de49d2a-d058-4b99-8699-970724fcd043 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:06.074753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3de49d2a-d058-4b99-8699-970724fcd043 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:06.101097 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3de49d2a-d058-4b99-8699-970724fcd043 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/ips" status: 200 len: 152 microversion: 2.20 time: 0.151032 May 19 14:00:06.102201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 382/754] 10.222.0.52 () {60 vars in 1288 bytes} [Thu May 19 14:00:05 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/ips => generated 152 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:00:06.117337 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-43b8b554-36fe-4385-b394-7df6499e9730 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:06.124722 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-43b8b554-36fe-4385-b394-7df6499e9730 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1366 microversion: 2.1 time: 0.153335 May 19 14:00:06.125289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 373/755] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:05 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:00:07.141412 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-eb3ace08-b56c-4051-b112-2225720847e6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:07.142023 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-eb3ace08-b56c-4051-b112-2225720847e6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:07.143876 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=8 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:07.149935 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-eb3ace08-b56c-4051-b112-2225720847e6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:07.150384 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-eb3ace08-b56c-4051-b112-2225720847e6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:07.151168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-eb3ace08-b56c-4051-b112-2225720847e6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:07.151602 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-eb3ace08-b56c-4051-b112-2225720847e6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:07.284534 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-eb3ace08-b56c-4051-b112-2225720847e6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:07.292163 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-eb3ace08-b56c-4051-b112-2225720847e6 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1557 microversion: 2.1 time: 0.154608 May 19 14:00:07.292720 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 383/756] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:07 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:07.308553 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-710b0334-41e0-494e-bd06-2effc51649ea tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:07.309058 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-710b0334-41e0-494e-bd06-2effc51649ea tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:07.311029 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=4 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:07.311681 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=16 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:07.318090 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-710b0334-41e0-494e-bd06-2effc51649ea tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:07.318539 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-710b0334-41e0-494e-bd06-2effc51649ea tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:07.319327 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-710b0334-41e0-494e-bd06-2effc51649ea tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:07.319763 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-710b0334-41e0-494e-bd06-2effc51649ea tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:07.397634 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-710b0334-41e0-494e-bd06-2effc51649ea tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093395 May 19 14:00:07.398221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 374/757] 10.222.0.52 () {58 vars in 1274 bytes} [Thu May 19 14:00:07 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:07.890796 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6747870e-97d2-49dd-9eef-565967195ec8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:07.891521 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6747870e-97d2-49dd-9eef-565967195ec8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:07.897731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6747870e-97d2-49dd-9eef-565967195ec8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:07.898190 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6747870e-97d2-49dd-9eef-565967195ec8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:07.899555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6747870e-97d2-49dd-9eef-565967195ec8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:07.900003 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6747870e-97d2-49dd-9eef-565967195ec8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:07.923256 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-6747870e-97d2-49dd-9eef-565967195ec8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lazy-loading 'flavor' on Instance uuid 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:00:07.973703 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:08.191205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6747870e-97d2-49dd-9eef-565967195ec8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/action" status: 202 len: 0 microversion: 2.20 time: 0.304425 May 19 14:00:08.192029 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 384/758] 10.222.0.52 () {62 vars in 1318 bytes} [Thu May 19 14:00:07 2022] POST /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 14:00:08.201209 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:08.201823 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:08.208307 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:08.208842 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:08.209744 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:08.210185 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:08.408560 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-579a85ab-00de-422b-a60e-89f92ceac1f1 req-95fe6b22-b084-4026-9774-354781250bfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e497045-70f8-4a86-9e3f-e1ecf7ac607a", "tag": "218713eb-c739-4649-b32f-d91de1913518"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:08.417611 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:08.418107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-579a85ab-00de-422b-a60e-89f92ceac1f1 req-95fe6b22-b084-4026-9774-354781250bfd service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:08.418447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-579a85ab-00de-422b-a60e-89f92ceac1f1 req-95fe6b22-b084-4026-9774-354781250bfd service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:08.420851 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:08.428377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:08.431076 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:08.431227 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-579a85ab-00de-422b-a60e-89f92ceac1f1 req-95fe6b22-b084-4026-9774-354781250bfd service nova] Creating event network-changed:218713eb-c739-4649-b32f-d91de1913518 for instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a on hv-cinder-78481 May 19 14:00:08.432251 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1bfe915a-30e5-4a81-95da-49f56a671de8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.235242 May 19 14:00:08.432807 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 375/759] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:08 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 14:00:08.436090 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-579a85ab-00de-422b-a60e-89f92ceac1f1 req-95fe6b22-b084-4026-9774-354781250bfd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032348 May 19 14:00:08.436930 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 385/760] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:09.452308 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:09.452915 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:09.460097 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:09.460544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:09.461535 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:09.461983 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:09.595859 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:09.604838 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:09.606335 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:09.607524 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1c160379-07ac-46bb-a1bd-55038acf4c8f tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.159746 May 19 14:00:09.608088 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 376/761] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:09 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:10.627151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:10.627850 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:10.635237 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:10.635696 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:10.636468 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:10.636920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:10.765000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:10.773393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:10.775112 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:10.776277 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7272a1a6-7978-4a76-a140-8a1765303f01 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.154096 May 19 14:00:10.776824 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 386/762] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:10 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:11.795060 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:11.795670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:11.802113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:11.802559 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:11.803464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:11.803900 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:11.928837 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:11.937618 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:11.939139 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:11.940286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-46a96078-9dce-461e-b4d6-61d20b4d3a5b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.149168 May 19 14:00:11.940842 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 377/763] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:11 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:12.957913 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:12.958541 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:12.965448 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:12.965896 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:12.966654 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:12.967114 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:13.095091 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:13.103787 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:13.105281 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:13.106475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-79902a15-af99-4b5a-bcc9-0f8af84f0358 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.152794 May 19 14:00:13.107052 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 387/764] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:12 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:14.124423 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:14.125039 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:14.131817 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:14.132271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:14.133174 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:14.133615 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:14.260001 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:14.267854 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:14.269384 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:14.270535 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ebc2acd8-7e27-471a-a286-5cbd5cdaf3d7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.150046 May 19 14:00:14.271121 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 378/765] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:14 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:15.288103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:15.288640 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:15.295247 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:15.295694 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:15.296450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:15.296911 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:15.430876 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:15.438752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:15.440292 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:15.441561 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e19cac26-2d3a-4fae-a630-dab7738ecd06 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.157398 May 19 14:00:15.442115 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 388/766] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:15 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:16.460309 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:16.460918 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:16.468052 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:16.468500 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:16.469266 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:16.469698 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:16.595855 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:16.604386 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:16.605823 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:16.606982 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d4a2b8c5-b8ea-4718-9240-d29e467b8c4d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.150586 May 19 14:00:16.607545 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 379/767] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:16 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:17.624941 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:17.625578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:17.632474 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:17.632929 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:17.633781 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:17.634208 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:17.767344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:17.775927 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:17.777459 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:17.778783 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b469f8a6-db52-4334-a9ac-2d7c0cd9b970 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.157747 May 19 14:00:17.779407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 389/768] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:17 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:18.797777 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:18.798323 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:18.805501 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:18.806000 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:18.806845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:18.807296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:18.965730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:18.974013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:18.975725 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:18.976908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-55abd3db-654c-4131-87ea-2f7e1061870b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.183159 May 19 14:00:18.978198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 380/769] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:18 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:19.996655 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:19.997436 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:20.004137 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:20.004595 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:20.005375 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:20.006075 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:20.138076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:20.146176 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:20.147722 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:20.149313 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8acc2081-c75a-4bc6-aea4-6fe8030f774e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1744 microversion: 2.20 time: 0.156262 May 19 14:00:20.149878 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 390/770] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:19 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:21.168426 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:21.169049 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:21.175521 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:21.175700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:21.176475 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:21.176915 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:21.314531 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:21.323233 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:21.324729 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:21.326050 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-085f1892-5a2a-4d08-ae09-ffc826e00090 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1739 microversion: 2.20 time: 0.162451 May 19 14:00:21.326425 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 381/771] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:21 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:22.344312 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:22.345629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:22.352692 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:22.353364 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:22.354150 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:22.354594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:22.514818 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:22.525368 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:22.526792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:22.528131 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-efce7c0a-1fc8-4474-95c5-a13846af2d8d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1739 microversion: 2.20 time: 0.188209 May 19 14:00:22.528671 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 391/772] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:22 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:22.817867 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-83650ec1-9d0d-4699-8993-2104a3874c0a req-8d0fdd49-1967-44c6-a2f7-76c4ecf96e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea89fb6-a6ad-4aaf-9c6a-c06816051a96", "name": "network-vif-plugged", "status": "completed", "tag": "b57d1bfa-eb18-42d5-a8b6-81fae3792bb9"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:22.828012 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-83650ec1-9d0d-4699-8993-2104a3874c0a req-8d0fdd49-1967-44c6-a2f7-76c4ecf96e0b service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:22.828699 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-83650ec1-9d0d-4699-8993-2104a3874c0a req-8d0fdd49-1967-44c6-a2f7-76c4ecf96e0b service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:22.843269 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-83650ec1-9d0d-4699-8993-2104a3874c0a req-8d0fdd49-1967-44c6-a2f7-76c4ecf96e0b service nova] Creating event network-vif-plugged:b57d1bfa-eb18-42d5-a8b6-81fae3792bb9 for instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 on hv-cinder-78481 May 19 14:00:22.849270 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-83650ec1-9d0d-4699-8993-2104a3874c0a req-8d0fdd49-1967-44c6-a2f7-76c4ecf96e0b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034944 May 19 14:00:22.852179 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 382/773] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:23.546707 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:23.548102 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:23.555266 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:23.555740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:23.556523 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:23.556966 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:23.701564 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:23.711886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:23.713427 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:23.714616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f2a1c0e2-d7e5-487c-899d-7b1421975eac tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1739 microversion: 2.20 time: 0.171952 May 19 14:00:23.715216 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 392/774] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:23 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:24.734764 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:24.736109 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:24.743167 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:24.743913 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:24.744853 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:24.745291 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:24.881036 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:24.892170 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:24.894604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:24.896770 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cc45398a-f346-47b7-947a-f86ddc0f0cb7 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1739 microversion: 2.20 time: 0.166759 May 19 14:00:24.898106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 383/775] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:24 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:25.916513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:25.917736 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:25.924200 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:25.924650 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:25.925420 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:25.925852 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:26.067578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:26.081215 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:26.084208 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:26.086970 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-844b6e89-297b-475a-a420-f69450ce3260 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1739 microversion: 2.20 time: 0.173717 May 19 14:00:26.098427 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 393/776] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:25 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:27.106106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:27.106671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:27.111947 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=43 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:27.116569 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:27.117023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:27.118276 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:27.118725 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:27.271517 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:27.279928 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:27.281564 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:27.282790 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-29ca6ed6-cab1-4ed9-ba78-6e116563b60a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1739 microversion: 2.20 time: 0.181262 May 19 14:00:27.294932 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 384/777] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:27 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:28.303771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:28.304458 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:28.311649 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:28.312105 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:28.312894 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:28.313328 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:28.489735 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:28.498308 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:28.499855 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:28.501193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-01384482-e41a-408f-a416-791908ac9ce3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1739 microversion: 2.20 time: 0.201398 May 19 14:00:28.512782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 394/778] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:28 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:29.520019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:29.522928 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:29.533818 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:29.534472 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:29.535286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:29.535722 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:29.690575 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:29.690793 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ec8be7e5-d9e5-4858-8e4f-19caf807afac tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:29.691414 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ec8be7e5-d9e5-4858-8e4f-19caf807afac tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:29.698399 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ec8be7e5-d9e5-4858-8e4f-19caf807afac tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:29.699146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ec8be7e5-d9e5-4858-8e4f-19caf807afac tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:29.699776 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:29.700442 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ec8be7e5-d9e5-4858-8e4f-19caf807afac tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:29.701103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ec8be7e5-d9e5-4858-8e4f-19caf807afac tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:29.701306 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:29.702536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c305307e-8568-4baf-84b8-afc012f91f0b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1739 microversion: 2.20 time: 0.186437 May 19 14:00:29.710906 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 385/779] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:29 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:29.725922 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-ec8be7e5-d9e5-4858-8e4f-19caf807afac tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lazy-loading 'flavor' on Instance uuid 7ccab6e9-3133-4db9-a8d9-27c83353c00a {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:00:29.815904 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ec8be7e5-d9e5-4858-8e4f-19caf807afac tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "POST /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a/action" status: 202 len: 0 microversion: 2.1 time: 0.129319 May 19 14:00:29.817554 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 395/780] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 14:00:29 2022] POST /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:00:29.826324 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-19d58c96-ca26-4322-a102-b92f18cf39b3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:29.827135 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-19d58c96-ca26-4322-a102-b92f18cf39b3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:29.833638 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19d58c96-ca26-4322-a102-b92f18cf39b3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:29.834110 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19d58c96-ca26-4322-a102-b92f18cf39b3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:29.834969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19d58c96-ca26-4322-a102-b92f18cf39b3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:29.835408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19d58c96-ca26-4322-a102-b92f18cf39b3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:29.978127 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-19d58c96-ca26-4322-a102-b92f18cf39b3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:29.988046 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-19d58c96-ca26-4322-a102-b92f18cf39b3 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.165995 May 19 14:00:29.988865 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 386/781] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:29 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:30.723639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:30.724288 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:30.731082 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:30.731534 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:30.732298 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:30.732740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:30.864429 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:30.872920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:30.874432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:30.875663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-64490c8b-5b30-4c07-aadf-01691d9768b1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1721 microversion: 2.20 time: 0.157022 May 19 14:00:30.876235 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 396/782] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:30 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:31.006304 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bc688843-d7ea-450f-9d83-d422cbb8d858 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:31.007058 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bc688843-d7ea-450f-9d83-d422cbb8d858 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:31.014135 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc688843-d7ea-450f-9d83-d422cbb8d858 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:31.014583 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc688843-d7ea-450f-9d83-d422cbb8d858 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:31.015391 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc688843-d7ea-450f-9d83-d422cbb8d858 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:31.015829 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc688843-d7ea-450f-9d83-d422cbb8d858 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:31.158637 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bc688843-d7ea-450f-9d83-d422cbb8d858 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:31.167082 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bc688843-d7ea-450f-9d83-d422cbb8d858 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.164704 May 19 14:00:31.167680 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 387/783] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:31 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:31.893534 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:31.894151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:31.901258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:31.901710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:31.902477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:31.902946 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:32.030537 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:32.038450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:32.040599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:32.041756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d5927ad3-a048-4a6c-8fad-a84cf53592c8 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1721 microversion: 2.20 time: 0.152131 May 19 14:00:32.042316 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 397/784] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:31 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:32.184207 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a1c2a08f-9968-40ee-9117-03d193db5b68 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:32.184748 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a1c2a08f-9968-40ee-9117-03d193db5b68 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:32.191233 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a1c2a08f-9968-40ee-9117-03d193db5b68 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:32.191690 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a1c2a08f-9968-40ee-9117-03d193db5b68 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:32.192456 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a1c2a08f-9968-40ee-9117-03d193db5b68 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:32.192896 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a1c2a08f-9968-40ee-9117-03d193db5b68 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:32.324153 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a1c2a08f-9968-40ee-9117-03d193db5b68 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:32.331930 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a1c2a08f-9968-40ee-9117-03d193db5b68 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.151665 May 19 14:00:32.332489 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 388/785] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:32 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:33.060339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:33.060958 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:33.067776 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:33.068234 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:33.069002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:33.069447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:33.197513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:33.205556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:33.207173 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:33.208343 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d00d7c18-9853-4698-b83a-c4e82d7b3819 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1721 microversion: 2.20 time: 0.152052 May 19 14:00:33.208902 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 398/786] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:33 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:33.352147 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e1065eb4-3e16-4f0e-ad08-9967ae4dd54e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:33.352742 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e1065eb4-3e16-4f0e-ad08-9967ae4dd54e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:33.359158 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e1065eb4-3e16-4f0e-ad08-9967ae4dd54e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:33.359601 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e1065eb4-3e16-4f0e-ad08-9967ae4dd54e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:33.360354 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e1065eb4-3e16-4f0e-ad08-9967ae4dd54e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:33.360786 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e1065eb4-3e16-4f0e-ad08-9967ae4dd54e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:33.495834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e1065eb4-3e16-4f0e-ad08-9967ae4dd54e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:33.503658 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e1065eb4-3e16-4f0e-ad08-9967ae4dd54e tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.155749 May 19 14:00:33.504223 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 389/787] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:33 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:34.225901 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:34.226516 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:34.234154 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:34.234760 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:34.235710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:34.236155 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:34.251081 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:34.367630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:34.376127 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:34.377657 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:34.378826 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e9300a31-f62d-49ca-8239-a1508e1f9712 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1664 microversion: 2.20 time: 0.156958 May 19 14:00:34.379412 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 399/788] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:34 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:34.397249 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0cb8a58b-2a43-4cd4-a0ab-5119190f1f89 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08f2bfc6-3320-457f-86ff-fc11209a0fad"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:34.398332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0cb8a58b-2a43-4cd4-a0ab-5119190f1f89 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:34.404868 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb8a58b-2a43-4cd4-a0ab-5119190f1f89 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:34.405317 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb8a58b-2a43-4cd4-a0ab-5119190f1f89 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:34.406087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb8a58b-2a43-4cd4-a0ab-5119190f1f89 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:34.406523 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb8a58b-2a43-4cd4-a0ab-5119190f1f89 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:34.519807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d68b785f-6a0c-4a4a-beeb-852cf786322c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:34.520414 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d68b785f-6a0c-4a4a-beeb-852cf786322c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:34.526778 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d68b785f-6a0c-4a4a-beeb-852cf786322c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:34.527166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d68b785f-6a0c-4a4a-beeb-852cf786322c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:34.527928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d68b785f-6a0c-4a4a-beeb-852cf786322c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:34.528361 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d68b785f-6a0c-4a4a-beeb-852cf786322c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:34.665748 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d68b785f-6a0c-4a4a-beeb-852cf786322c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:34.672814 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:34.674050 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d68b785f-6a0c-4a4a-beeb-852cf786322c tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.158007 May 19 14:00:34.674659 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 400/789] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:34 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:00:34.688254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0cb8a58b-2a43-4cd4-a0ab-5119190f1f89 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295091 May 19 14:00:34.688843 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 390/790] 10.222.0.52 () {62 vars in 1363 bytes} [Thu May 19 14:00:34 2022] POST /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 14:00:34.804358 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4e9ab68b-6411-4daa-acde-74cb0371630a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:34.804790 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4e9ab68b-6411-4daa-acde-74cb0371630a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:34.811068 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4e9ab68b-6411-4daa-acde-74cb0371630a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:34.811523 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4e9ab68b-6411-4daa-acde-74cb0371630a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:34.812523 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4e9ab68b-6411-4daa-acde-74cb0371630a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:34.812967 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4e9ab68b-6411-4daa-acde-74cb0371630a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:34.899272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-7680198b-6143-42f4-8690-806e6612d932 req-44b9fef9-a4f2-41a5-b423-f1edea91aff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea89fb6-a6ad-4aaf-9c6a-c06816051a96", "name": "network-vif-unplugged", "status": "completed", "tag": "b57d1bfa-eb18-42d5-a8b6-81fae3792bb9"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:34.909258 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7680198b-6143-42f4-8690-806e6612d932 req-44b9fef9-a4f2-41a5-b423-f1edea91aff4 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:34.909786 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7680198b-6143-42f4-8690-806e6612d932 req-44b9fef9-a4f2-41a5-b423-f1edea91aff4 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:34.921128 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.compute.server_external_events [req-7680198b-6143-42f4-8690-806e6612d932 req-44b9fef9-a4f2-41a5-b423-f1edea91aff4 service nova] Unable to find a host for instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96. Dropping event network-vif-unplugged {{(pid=123752) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 14:00:34.922013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-7680198b-6143-42f4-8690-806e6612d932 req-44b9fef9-a4f2-41a5-b423-f1edea91aff4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026839 May 19 14:00:34.922909 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 391/791] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 14:00:35.057922 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4e9ab68b-6411-4daa-acde-74cb0371630a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/os-volume_attachments/08f2bfc6-3320-457f-86ff-fc11209a0fad" status: 202 len: 0 microversion: 2.20 time: 0.257648 May 19 14:00:35.058577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 401/792] 10.222.0.52 () {60 vars in 1456 bytes} [Thu May 19 14:00:34 2022] DELETE /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/os-volume_attachments/08f2bfc6-3320-457f-86ff-fc11209a0fad => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 14:00:35.114315 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e3e817da-f4f3-47b9-8d52-a94c5998bd43 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:35.114938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e3e817da-f4f3-47b9-8d52-a94c5998bd43 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:35.122006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3e817da-f4f3-47b9-8d52-a94c5998bd43 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:35.122456 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3e817da-f4f3-47b9-8d52-a94c5998bd43 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:35.123248 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3e817da-f4f3-47b9-8d52-a94c5998bd43 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:35.123689 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3e817da-f4f3-47b9-8d52-a94c5998bd43 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:35.200041 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e3e817da-f4f3-47b9-8d52-a94c5998bd43 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "POST /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/action" status: 202 len: 0 microversion: 2.20 time: 0.089463 May 19 14:00:35.200648 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 392/793] 10.222.0.52 () {62 vars in 1318 bytes} [Thu May 19 14:00:35 2022] POST /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 14:00:35.208865 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:35.209732 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:35.215846 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:35.216301 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:35.217076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:35.217514 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:35.354532 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:35.362757 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:35.364302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:35.365491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f28d8eb5-0b18-4b5d-9da7-4bf17367396e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1672 microversion: 2.20 time: 0.160694 May 19 14:00:35.366041 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 402/794] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:35 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:35.691201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-55343c9c-5653-4f45-ba3d-987ddf4682ed tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:35.691820 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-55343c9c-5653-4f45-ba3d-987ddf4682ed tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:35.699865 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55343c9c-5653-4f45-ba3d-987ddf4682ed tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:35.700312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55343c9c-5653-4f45-ba3d-987ddf4682ed tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:35.701073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55343c9c-5653-4f45-ba3d-987ddf4682ed tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:35.701505 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55343c9c-5653-4f45-ba3d-987ddf4682ed tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:35.835017 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55343c9c-5653-4f45-ba3d-987ddf4682ed tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:35.843566 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-55343c9c-5653-4f45-ba3d-987ddf4682ed tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.156562 May 19 14:00:35.844229 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 393/795] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:35 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:36.384993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:36.386223 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:36.388629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=42 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:36.394063 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:36.394517 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:36.395331 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:36.395772 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:36.529652 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:36.537714 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:36.539256 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:36.540983 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6170ed2d-36e5-4f9b-b5e0-0e2d90398022 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.159735 May 19 14:00:36.541574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 403/796] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:36 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:36.861004 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8ee155d1-d292-4ba9-b144-2a51081205a4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:36.861708 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8ee155d1-d292-4ba9-b144-2a51081205a4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:36.869061 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ee155d1-d292-4ba9-b144-2a51081205a4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:36.869607 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ee155d1-d292-4ba9-b144-2a51081205a4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:36.870390 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ee155d1-d292-4ba9-b144-2a51081205a4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:36.870824 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ee155d1-d292-4ba9-b144-2a51081205a4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:37.016655 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8ee155d1-d292-4ba9-b144-2a51081205a4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:37.024916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8ee155d1-d292-4ba9-b144-2a51081205a4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.167521 May 19 14:00:37.025448 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 394/797] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:36 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:37.559549 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:37.560191 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:37.566906 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:37.567360 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:37.568135 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:37.568571 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:37.707246 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:37.716105 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:37.717722 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:37.719606 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-189072c9-37b9-4528-9e85-b3c9edc7d0d1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.163583 May 19 14:00:37.722754 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 404/798] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:37 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:38.042826 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-663c4503-e9c8-48ac-8b63-1bc93777e04d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:38.043614 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-663c4503-e9c8-48ac-8b63-1bc93777e04d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:38.050328 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663c4503-e9c8-48ac-8b63-1bc93777e04d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:38.050885 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663c4503-e9c8-48ac-8b63-1bc93777e04d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:38.051743 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663c4503-e9c8-48ac-8b63-1bc93777e04d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:38.052251 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663c4503-e9c8-48ac-8b63-1bc93777e04d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:38.189538 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-663c4503-e9c8-48ac-8b63-1bc93777e04d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:38.198156 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-663c4503-e9c8-48ac-8b63-1bc93777e04d tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.159760 May 19 14:00:38.198932 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 395/799] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:38 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:38.738438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:38.739002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:38.746675 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:38.747252 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:38.748057 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:38.748513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:38.889820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:38.898411 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:38.901345 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:38.902853 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4c2fa0d9-2c26-434b-934c-603d29b82375 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.168431 May 19 14:00:38.903728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 405/800] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:38 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:39.215494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a4beb0de-4d57-4986-bedf-7565ab1434ee tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:39.216266 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a4beb0de-4d57-4986-bedf-7565ab1434ee tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:39.222789 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a4beb0de-4d57-4986-bedf-7565ab1434ee tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:39.223271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a4beb0de-4d57-4986-bedf-7565ab1434ee tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:39.224052 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a4beb0de-4d57-4986-bedf-7565ab1434ee tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:39.224492 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a4beb0de-4d57-4986-bedf-7565ab1434ee tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:39.362647 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a4beb0de-4d57-4986-bedf-7565ab1434ee tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:39.370525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a4beb0de-4d57-4986-bedf-7565ab1434ee tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.159436 May 19 14:00:39.371142 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 396/801] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:39 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:39.921495 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:39.922108 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:39.928676 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:39.929133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:39.929918 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:39.930360 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:40.068565 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:40.076824 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:40.078365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:40.079598 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-13f7efbe-939e-4d58-9ff7-97f6dcc2a813 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.162024 May 19 14:00:40.080390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 406/802] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:39 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 14:00:40.388652 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-08fbc366-a4c3-4f7b-9fc0-8222e65b8787 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:40.389406 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-08fbc366-a4c3-4f7b-9fc0-8222e65b8787 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:40.395694 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08fbc366-a4c3-4f7b-9fc0-8222e65b8787 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:40.396137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08fbc366-a4c3-4f7b-9fc0-8222e65b8787 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:40.396902 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08fbc366-a4c3-4f7b-9fc0-8222e65b8787 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:40.397359 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08fbc366-a4c3-4f7b-9fc0-8222e65b8787 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:40.548682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-08fbc366-a4c3-4f7b-9fc0-8222e65b8787 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:40.556471 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-08fbc366-a4c3-4f7b-9fc0-8222e65b8787 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.172998 May 19 14:00:40.557294 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 397/803] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:40 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:41.097686 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:41.098306 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:41.105135 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:41.105599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:41.106389 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:41.106884 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:41.245524 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:41.254644 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:41.256447 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:41.257625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6c38d2d4-0955-4043-a562-e71afaf8887e tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.163980 May 19 14:00:41.258430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 407/804] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:41 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:41.576126 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-847d4518-13a1-4894-9b2d-da766d234b79 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:41.576668 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-847d4518-13a1-4894-9b2d-da766d234b79 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:41.582652 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-847d4518-13a1-4894-9b2d-da766d234b79 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:41.583129 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-847d4518-13a1-4894-9b2d-da766d234b79 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:41.583894 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-847d4518-13a1-4894-9b2d-da766d234b79 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:41.584327 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-847d4518-13a1-4894-9b2d-da766d234b79 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:41.726617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-847d4518-13a1-4894-9b2d-da766d234b79 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:41.735067 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-847d4518-13a1-4894-9b2d-da766d234b79 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.163734 May 19 14:00:41.735740 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 398/805] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:41 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:42.277525 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:42.278356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:42.284631 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:42.285160 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:42.285947 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:42.286387 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:42.424677 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:42.436832 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:42.438944 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:42.440472 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1f031320-c2bb-4c33-981c-f7e4ec804428 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.168039 May 19 14:00:42.441687 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 408/806] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:42 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:42.752332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9b9544f9-cac4-477d-b4d8-36202d981210 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:42.752944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9b9544f9-cac4-477d-b4d8-36202d981210 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:42.761339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b9544f9-cac4-477d-b4d8-36202d981210 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:42.762104 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b9544f9-cac4-477d-b4d8-36202d981210 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:42.762910 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b9544f9-cac4-477d-b4d8-36202d981210 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:42.763353 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b9544f9-cac4-477d-b4d8-36202d981210 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:42.903012 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9b9544f9-cac4-477d-b4d8-36202d981210 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:42.910845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9b9544f9-cac4-477d-b4d8-36202d981210 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.162465 May 19 14:00:42.911615 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 399/807] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:42 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:43.459767 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:43.460378 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:43.468425 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:43.468875 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:43.469646 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:43.470080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:43.608792 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:43.617062 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:43.619172 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:43.620540 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f99fe1b8-0faa-4bb9-8f59-2dfe6b7cb2ee tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.164787 May 19 14:00:43.626996 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 409/808] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:43 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 14:00:43.928323 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2e87f8f3-3616-4f8b-93e6-01d114e1581f tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:43.929061 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2e87f8f3-3616-4f8b-93e6-01d114e1581f tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:43.936042 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e87f8f3-3616-4f8b-93e6-01d114e1581f tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:43.936497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e87f8f3-3616-4f8b-93e6-01d114e1581f tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:43.937270 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e87f8f3-3616-4f8b-93e6-01d114e1581f tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:43.937706 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e87f8f3-3616-4f8b-93e6-01d114e1581f tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:44.073234 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e87f8f3-3616-4f8b-93e6-01d114e1581f tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:44.081033 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2e87f8f3-3616-4f8b-93e6-01d114e1581f tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.156509 May 19 14:00:44.081609 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 400/809] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:43 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:44.641394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:44.643741 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:44.649941 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:44.650418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:44.651365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:44.651928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:44.793630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:44.801926 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:44.803468 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:44.804653 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2f416add-5fcc-4e98-a624-3c40d02b5213 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.167792 May 19 14:00:44.810912 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 410/810] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:44 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:45.099010 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-97946995-46aa-4f22-ba47-4c3f8478c470 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:45.100178 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-97946995-46aa-4f22-ba47-4c3f8478c470 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:45.108243 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-97946995-46aa-4f22-ba47-4c3f8478c470 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:45.108953 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-97946995-46aa-4f22-ba47-4c3f8478c470 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:45.109920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-97946995-46aa-4f22-ba47-4c3f8478c470 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:45.110365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-97946995-46aa-4f22-ba47-4c3f8478c470 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:45.261402 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-97946995-46aa-4f22-ba47-4c3f8478c470 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:45.269242 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-97946995-46aa-4f22-ba47-4c3f8478c470 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.174524 May 19 14:00:45.269809 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 401/811] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:45 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:45.824609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:45.825389 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:45.832054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:45.832512 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:45.833287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:45.833733 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:45.969990 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:45.978823 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:45.980559 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:45.982054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-079a7757-d1d3-4b9c-92cb-a8456fdca5e1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.161707 May 19 14:00:45.982740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 411/812] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:45 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:46.286683 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-604fb06c-891c-4c6f-8329-b2019559478b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:46.287304 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-604fb06c-891c-4c6f-8329-b2019559478b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:46.294317 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-604fb06c-891c-4c6f-8329-b2019559478b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:46.294762 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-604fb06c-891c-4c6f-8329-b2019559478b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:46.295558 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-604fb06c-891c-4c6f-8329-b2019559478b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:46.295989 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-604fb06c-891c-4c6f-8329-b2019559478b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:46.586060 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-604fb06c-891c-4c6f-8329-b2019559478b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:46.594524 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-604fb06c-891c-4c6f-8329-b2019559478b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.311868 May 19 14:00:46.595123 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 402/813] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:46 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:47.000643 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:47.001254 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:47.008073 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:47.008521 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:47.009547 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:47.009985 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:47.140752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:47.148690 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:47.151398 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:47.153201 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f2ef37c2-4232-4944-a8db-f3c32df91eb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.156644 May 19 14:00:47.154049 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 412/814] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:46 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:47.612372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7948ec8d-72ca-407c-a2a1-12d514c2297b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:47.612983 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7948ec8d-72ca-407c-a2a1-12d514c2297b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:47.619619 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7948ec8d-72ca-407c-a2a1-12d514c2297b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:47.620070 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7948ec8d-72ca-407c-a2a1-12d514c2297b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:47.620828 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7948ec8d-72ca-407c-a2a1-12d514c2297b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:47.621269 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7948ec8d-72ca-407c-a2a1-12d514c2297b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:47.999881 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7948ec8d-72ca-407c-a2a1-12d514c2297b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:48.007457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7948ec8d-72ca-407c-a2a1-12d514c2297b tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.398878 May 19 14:00:48.008004 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 403/815] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:47 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:48.177469 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:48.178077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:48.184854 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:48.185309 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:48.186076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:48.186517 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:48.204524 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:48.213816 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1ecc7abe-8946-406c-8be1-6908c5f24bfa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:48.214339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1ecc7abe-8946-406c-8be1-6908c5f24bfa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:48.220370 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ecc7abe-8946-406c-8be1-6908c5f24bfa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:48.220823 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ecc7abe-8946-406c-8be1-6908c5f24bfa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:48.221624 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ecc7abe-8946-406c-8be1-6908c5f24bfa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:48.222169 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ecc7abe-8946-406c-8be1-6908c5f24bfa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:48.245759 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1ecc7abe-8946-406c-8be1-6908c5f24bfa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/ips" status: 200 len: 146 microversion: 2.1 time: 0.036144 May 19 14:00:48.246320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 404/816] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 14:00:48 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:00:48.318816 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:48.327186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:48.328710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:48.329867 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-05bc2552-a112-4e8d-a278-96981d19e602 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.156412 May 19 14:00:48.330438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 413/817] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:48 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:49.024332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dadae5bd-c684-43a6-b54b-1c2959ce9412 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:49.024962 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dadae5bd-c684-43a6-b54b-1c2959ce9412 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:49.031600 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dadae5bd-c684-43a6-b54b-1c2959ce9412 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:49.032051 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dadae5bd-c684-43a6-b54b-1c2959ce9412 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:49.032822 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dadae5bd-c684-43a6-b54b-1c2959ce9412 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:49.033266 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dadae5bd-c684-43a6-b54b-1c2959ce9412 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:49.166092 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-dadae5bd-c684-43a6-b54b-1c2959ce9412 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:49.173537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dadae5bd-c684-43a6-b54b-1c2959ce9412 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.153170 May 19 14:00:49.174101 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 405/818] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:49 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:49.348440 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:49.348975 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:49.356396 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:49.356849 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:49.357645 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:49.358084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:49.489810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:49.498303 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:49.499844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:49.501008 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e197a57f-c3c3-4608-aeb5-7f09f4b39ff0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.156664 May 19 14:00:49.501568 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 414/819] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:49 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:50.190917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9ee273ba-1818-4fd1-9b53-ddde0c2b93df tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:50.191543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9ee273ba-1818-4fd1-9b53-ddde0c2b93df tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:50.198713 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ee273ba-1818-4fd1-9b53-ddde0c2b93df tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:50.199202 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ee273ba-1818-4fd1-9b53-ddde0c2b93df tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:50.199964 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ee273ba-1818-4fd1-9b53-ddde0c2b93df tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:50.200404 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ee273ba-1818-4fd1-9b53-ddde0c2b93df tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:50.340569 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9ee273ba-1818-4fd1-9b53-ddde0c2b93df tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:50.349536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9ee273ba-1818-4fd1-9b53-ddde0c2b93df tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.162526 May 19 14:00:50.350274 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 406/820] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:50 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:50.519842 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:50.520373 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:50.526823 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:50.527312 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:50.528077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:50.528517 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:50.654556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:50.662556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:50.664108 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:50.665806 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-85f0ef5f-c46b-4001-9247-4a97cf6176d0 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.150143 May 19 14:00:50.666364 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 415/821] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:50 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:50.744032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-75ee23c9-cfe3-4487-9adf-ee54e33f404f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e38adc76-7c72-4a69-9f4d-714a05f01fdf"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:50.745151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-75ee23c9-cfe3-4487-9adf-ee54e33f404f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:50.751319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75ee23c9-cfe3-4487-9adf-ee54e33f404f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:50.751766 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75ee23c9-cfe3-4487-9adf-ee54e33f404f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:50.752560 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75ee23c9-cfe3-4487-9adf-ee54e33f404f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:50.752998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75ee23c9-cfe3-4487-9adf-ee54e33f404f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:50.757619 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:51.032735 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-75ee23c9-cfe3-4487-9adf-ee54e33f404f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292826 May 19 14:00:51.033256 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 407/822] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 14:00:50 2022] POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:51.368096 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-82f5687f-db75-47f5-8c4c-12bfa979dfd4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:51.368727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-82f5687f-db75-47f5-8c4c-12bfa979dfd4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:51.376085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-82f5687f-db75-47f5-8c4c-12bfa979dfd4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:51.376551 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-82f5687f-db75-47f5-8c4c-12bfa979dfd4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:51.377622 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-82f5687f-db75-47f5-8c4c-12bfa979dfd4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:51.378195 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-82f5687f-db75-47f5-8c4c-12bfa979dfd4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:51.533187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-82f5687f-db75-47f5-8c4c-12bfa979dfd4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:51.540673 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-82f5687f-db75-47f5-8c4c-12bfa979dfd4 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1510 microversion: 2.1 time: 0.176634 May 19 14:00:51.541210 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 416/823] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:51 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:51.558259 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0f6948e4-8804-4d74-9e11-fd5fd60d0389 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:51.559032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0f6948e4-8804-4d74-9e11-fd5fd60d0389 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:51.565375 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f6948e4-8804-4d74-9e11-fd5fd60d0389 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:51.565828 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f6948e4-8804-4d74-9e11-fd5fd60d0389 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:51.566598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f6948e4-8804-4d74-9e11-fd5fd60d0389 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:51.567069 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f6948e4-8804-4d74-9e11-fd5fd60d0389 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:51.650834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0f6948e4-8804-4d74-9e11-fd5fd60d0389 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "POST /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a/action" status: 202 len: 0 microversion: 2.1 time: 0.097148 May 19 14:00:51.651445 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 408/824] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 14:00:51 2022] POST /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:00:51.659393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c0e49f17-5e98-41af-884f-dd3ed38bb047 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:51.660006 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c0e49f17-5e98-41af-884f-dd3ed38bb047 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:51.665925 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c0e49f17-5e98-41af-884f-dd3ed38bb047 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:51.666373 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c0e49f17-5e98-41af-884f-dd3ed38bb047 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:51.667159 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c0e49f17-5e98-41af-884f-dd3ed38bb047 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:51.667594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c0e49f17-5e98-41af-884f-dd3ed38bb047 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:51.684945 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:51.685646 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:51.692786 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:51.693237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:51.694035 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:51.694611 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:51.876780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c0e49f17-5e98-41af-884f-dd3ed38bb047 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:51.885456 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c0e49f17-5e98-41af-884f-dd3ed38bb047 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1518 microversion: 2.1 time: 0.229762 May 19 14:00:51.895408 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 417/825] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:51 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1518 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:51.900585 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:51.909985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:51.911595 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:51.912785 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-87460328-1ced-4af2-8be6-f8f9461f6f98 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.232613 May 19 14:00:51.913333 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 409/826] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:51 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 14:00:52.132767 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4e752b99-de03-4be7-bfdd-83125c294795 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:52.133861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4e752b99-de03-4be7-bfdd-83125c294795 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:52.140044 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4e752b99-de03-4be7-bfdd-83125c294795 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:52.140716 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4e752b99-de03-4be7-bfdd-83125c294795 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:52.141582 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4e752b99-de03-4be7-bfdd-83125c294795 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:52.142168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4e752b99-de03-4be7-bfdd-83125c294795 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:52.167388 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4e752b99-de03-4be7-bfdd-83125c294795 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/ips" status: 200 len: 151 microversion: 2.1 time: 0.039261 May 19 14:00:52.167969 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 418/827] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 14:00:52 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:52.902814 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-23727c19-ac14-4786-999a-6e15f638fdc6 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:52.903453 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-23727c19-ac14-4786-999a-6e15f638fdc6 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:52.910006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-23727c19-ac14-4786-999a-6e15f638fdc6 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:52.910458 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-23727c19-ac14-4786-999a-6e15f638fdc6 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:52.911703 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-23727c19-ac14-4786-999a-6e15f638fdc6 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:52.912154 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-23727c19-ac14-4786-999a-6e15f638fdc6 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:52.931786 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:52.932428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:52.940690 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:52.941223 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:52.942024 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:52.942462 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:53.098898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-23727c19-ac14-4786-999a-6e15f638fdc6 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:53.107315 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-23727c19-ac14-4786-999a-6e15f638fdc6 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1520 microversion: 2.1 time: 0.208412 May 19 14:00:53.107887 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 410/828] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:52 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:53.112424 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-5bef77ec-13c6-4513-99de-b9bda86f78a4 req-b9f92c25-5e18-4598-a542-4485ed39bf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea89fb6-a6ad-4aaf-9c6a-c06816051a96", "name": "network-vif-plugged", "status": "completed", "tag": "b57d1bfa-eb18-42d5-a8b6-81fae3792bb9"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:53.120734 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-5bef77ec-13c6-4513-99de-b9bda86f78a4 req-b9f92c25-5e18-4598-a542-4485ed39bf1f service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:53.121181 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-5bef77ec-13c6-4513-99de-b9bda86f78a4 req-b9f92c25-5e18-4598-a542-4485ed39bf1f service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:53.126995 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:53.132594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-5bef77ec-13c6-4513-99de-b9bda86f78a4 req-b9f92c25-5e18-4598-a542-4485ed39bf1f service nova] Creating event network-vif-plugged:b57d1bfa-eb18-42d5-a8b6-81fae3792bb9 for instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 on hv-cinder-78481 May 19 14:00:53.135435 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:53.137132 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:53.137514 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-5bef77ec-13c6-4513-99de-b9bda86f78a4 req-b9f92c25-5e18-4598-a542-4485ed39bf1f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028533 May 19 14:00:53.138268 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 411/829] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:53.138448 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4a001a59-ef1e-441c-b62d-0b34196b74b2 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.211363 May 19 14:00:53.139024 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 419/830] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:52 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 14:00:53.503911 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d5c6f77a-8562-475d-8b0c-113ad93ea820 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bef51b05-5a19-4b1c-a6b0-9c054dc34a5b"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:53.505053 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d5c6f77a-8562-475d-8b0c-113ad93ea820 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:53.512848 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5c6f77a-8562-475d-8b0c-113ad93ea820 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:53.513294 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5c6f77a-8562-475d-8b0c-113ad93ea820 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:53.514082 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5c6f77a-8562-475d-8b0c-113ad93ea820 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:53.514516 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5c6f77a-8562-475d-8b0c-113ad93ea820 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:53.862732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d5c6f77a-8562-475d-8b0c-113ad93ea820 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "POST /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362916 May 19 14:00:53.863377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 412/831] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 14:00:53 2022] POST /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:00:54.124960 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f5b32986-1cd7-4595-b633-1de8b7f8cc65 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:54.125651 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f5b32986-1cd7-4595-b633-1de8b7f8cc65 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:54.132679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5b32986-1cd7-4595-b633-1de8b7f8cc65 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:54.133120 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5b32986-1cd7-4595-b633-1de8b7f8cc65 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:54.134758 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5b32986-1cd7-4595-b633-1de8b7f8cc65 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:54.135235 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f5b32986-1cd7-4595-b633-1de8b7f8cc65 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:54.157204 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:54.158007 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:54.164755 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:54.165335 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:54.166257 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:54.166653 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:54.317679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f5b32986-1cd7-4595-b633-1de8b7f8cc65 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:54.325478 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f5b32986-1cd7-4595-b633-1de8b7f8cc65 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1520 microversion: 2.1 time: 0.204406 May 19 14:00:54.326048 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 420/832] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:54 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:54.343847 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:54.351822 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:54.353816 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:54.354992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-af331263-0527-4e1a-a92c-4907f4bb0fce tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1730 microversion: 2.20 time: 0.202106 May 19 14:00:54.355550 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 413/833] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:54 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 14:00:55.154105 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-5c85c598-ae0e-425a-873c-67858a5e1b21 req-b23fd9d2-1db5-44f2-8aa5-a3e031359726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccab6e9-3133-4db9-a8d9-27c83353c00a", "name": "network-vif-unplugged", "status": "completed", "tag": "80eac5d4-3a31-4ac5-b15f-b7109c704ba1"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:55.162618 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-5c85c598-ae0e-425a-873c-67858a5e1b21 req-b23fd9d2-1db5-44f2-8aa5-a3e031359726 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:55.163111 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-5c85c598-ae0e-425a-873c-67858a5e1b21 req-b23fd9d2-1db5-44f2-8aa5-a3e031359726 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:55.173976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.compute.server_external_events [req-5c85c598-ae0e-425a-873c-67858a5e1b21 req-b23fd9d2-1db5-44f2-8aa5-a3e031359726 service nova] Unable to find a host for instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a. Dropping event network-vif-unplugged {{(pid=123751) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 14:00:55.174827 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-5c85c598-ae0e-425a-873c-67858a5e1b21 req-b23fd9d2-1db5-44f2-8aa5-a3e031359726 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025441 May 19 14:00:55.175416 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 421/834] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 19 14:00:55.341873 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e2baae0a-9f45-47cd-b90c-f0218b5d7d26 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:55.342488 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e2baae0a-9f45-47cd-b90c-f0218b5d7d26 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:55.348922 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2baae0a-9f45-47cd-b90c-f0218b5d7d26 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:55.349369 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2baae0a-9f45-47cd-b90c-f0218b5d7d26 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:55.350134 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2baae0a-9f45-47cd-b90c-f0218b5d7d26 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:55.350572 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2baae0a-9f45-47cd-b90c-f0218b5d7d26 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:55.373530 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:55.374175 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:55.380166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:55.380613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:55.381635 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:55.382074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:55.545398 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e2baae0a-9f45-47cd-b90c-f0218b5d7d26 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:55.553217 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e2baae0a-9f45-47cd-b90c-f0218b5d7d26 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1520 microversion: 2.1 time: 0.215151 May 19 14:00:55.553872 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 414/835] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:55 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:55.559587 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:55.567607 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:55.569123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:55.570428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2cd6b685-b0ec-4d40-afd7-e71a5dcdae34 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1717 microversion: 2.20 time: 0.200890 May 19 14:00:55.571788 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 422/836] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:00:55 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1717 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:00:56.571884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cbaa5221-6b6f-4bfd-bb95-9da2a08c0b45 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:56.572562 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cbaa5221-6b6f-4bfd-bb95-9da2a08c0b45 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:56.579065 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cbaa5221-6b6f-4bfd-bb95-9da2a08c0b45 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:56.579456 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cbaa5221-6b6f-4bfd-bb95-9da2a08c0b45 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:56.580217 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cbaa5221-6b6f-4bfd-bb95-9da2a08c0b45 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:56.580653 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cbaa5221-6b6f-4bfd-bb95-9da2a08c0b45 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:56.715215 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cbaa5221-6b6f-4bfd-bb95-9da2a08c0b45 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:56.722961 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cbaa5221-6b6f-4bfd-bb95-9da2a08c0b45 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1520 microversion: 2.1 time: 0.155447 May 19 14:00:56.723519 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 415/837] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:56 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:57.740548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-94afcdf5-34fb-40ce-afae-32dcd88913b1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:57.741118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-94afcdf5-34fb-40ce-afae-32dcd88913b1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:57.748121 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-94afcdf5-34fb-40ce-afae-32dcd88913b1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:57.748604 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-94afcdf5-34fb-40ce-afae-32dcd88913b1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:57.749378 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-94afcdf5-34fb-40ce-afae-32dcd88913b1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:57.749848 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-94afcdf5-34fb-40ce-afae-32dcd88913b1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:57.878099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-94afcdf5-34fb-40ce-afae-32dcd88913b1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:57.886952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-94afcdf5-34fb-40ce-afae-32dcd88913b1 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1520 microversion: 2.1 time: 0.150695 May 19 14:00:57.887522 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 423/838] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:57 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:58.547026 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3ce6a964-179c-48f7-a4a4-f35c2741cb2d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:00:58.549529 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=68 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:00:58.554835 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3ce6a964-179c-48f7-a4a4-f35c2741cb2d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:58.555332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3ce6a964-179c-48f7-a4a4-f35c2741cb2d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:58.619166 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3ce6a964-179c-48f7-a4a4-f35c2741cb2d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Going to try to stop instance {{(pid=123752) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 14:00:58.666372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3ce6a964-179c-48f7-a4a4-f35c2741cb2d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/action" status: 202 len: 0 microversion: 2.1 time: 0.122278 May 19 14:00:58.670109 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 416/839] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 14:00:58 2022] POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:00:58.675501 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-86ea7d38-38f7-4b43-b7bf-d94e58038965 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:58.676126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-86ea7d38-38f7-4b43-b7bf-d94e58038965 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:58.682261 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-86ea7d38-38f7-4b43-b7bf-d94e58038965 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:58.682730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-86ea7d38-38f7-4b43-b7bf-d94e58038965 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:58.683546 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-86ea7d38-38f7-4b43-b7bf-d94e58038965 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:58.683979 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-86ea7d38-38f7-4b43-b7bf-d94e58038965 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:58.817719 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-86ea7d38-38f7-4b43-b7bf-d94e58038965 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:58.826650 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-86ea7d38-38f7-4b43-b7bf-d94e58038965 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.154943 May 19 14:00:58.827258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 424/840] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:58 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:00:58.905047 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4e9ee1f7-f59f-4e67-b4ca-7bbe58316ccc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:58.905747 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4e9ee1f7-f59f-4e67-b4ca-7bbe58316ccc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:58.911969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e9ee1f7-f59f-4e67-b4ca-7bbe58316ccc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:58.912362 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e9ee1f7-f59f-4e67-b4ca-7bbe58316ccc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:58.913121 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e9ee1f7-f59f-4e67-b4ca-7bbe58316ccc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:58.913554 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e9ee1f7-f59f-4e67-b4ca-7bbe58316ccc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:59.044040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4e9ee1f7-f59f-4e67-b4ca-7bbe58316ccc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:59.051657 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4e9ee1f7-f59f-4e67-b4ca-7bbe58316ccc tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.150904 May 19 14:00:59.052222 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 417/841] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:58 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:00:59.381288 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:00:59.381494 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Thu May 19 14:00:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:00:59.843856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fc9b4d74-4e53-412c-a239-0fc9c984e7d3 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:00:59.844482 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-fc9b4d74-4e53-412c-a239-0fc9c984e7d3 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:00:59.851143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fc9b4d74-4e53-412c-a239-0fc9c984e7d3 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:59.851600 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fc9b4d74-4e53-412c-a239-0fc9c984e7d3 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:59.852530 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fc9b4d74-4e53-412c-a239-0fc9c984e7d3 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:00:59.853063 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fc9b4d74-4e53-412c-a239-0fc9c984e7d3 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:00:59.979166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-fc9b4d74-4e53-412c-a239-0fc9c984e7d3 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:00:59.987084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-fc9b4d74-4e53-412c-a239-0fc9c984e7d3 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.147063 May 19 14:00:59.987638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 425/842] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:00:59 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:00.068682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-83b1101e-98e9-435e-b239-b816e15b064a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:00.069289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-83b1101e-98e9-435e-b239-b816e15b064a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:00.076372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83b1101e-98e9-435e-b239-b816e15b064a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:00.076813 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83b1101e-98e9-435e-b239-b816e15b064a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:00.077560 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83b1101e-98e9-435e-b239-b816e15b064a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:00.077991 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83b1101e-98e9-435e-b239-b816e15b064a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:00.208615 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-83b1101e-98e9-435e-b239-b816e15b064a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:00.216211 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-83b1101e-98e9-435e-b239-b816e15b064a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.151491 May 19 14:01:00.217096 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 418/843] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:00 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:00.401119 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-574eeae9-9c59-4267-ba8b-515aa0328527 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:00.401873 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-574eeae9-9c59-4267-ba8b-515aa0328527 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:00.407631 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-574eeae9-9c59-4267-ba8b-515aa0328527 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:00.408084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-574eeae9-9c59-4267-ba8b-515aa0328527 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:00.408847 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-574eeae9-9c59-4267-ba8b-515aa0328527 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:00.409282 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-574eeae9-9c59-4267-ba8b-515aa0328527 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:00.489791 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-574eeae9-9c59-4267-ba8b-515aa0328527 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lazy-loading 'services' on Instance uuid 3e497045-70f8-4a86-9e3f-e1ecf7ac607a {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:01:00.561074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-574eeae9-9c59-4267-ba8b-515aa0328527 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-volume_attachments/bef51b05-5a19-4b1c-a6b0-9c054dc34a5b" status: 202 len: 0 microversion: 2.1 time: 0.164303 May 19 14:01:00.561675 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 426/844] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 14:01:00 2022] DELETE /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-volume_attachments/bef51b05-5a19-4b1c-a6b0-9c054dc34a5b => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:01:00.569964 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-38ad3164-370d-451c-84cc-5db52aed27da tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:00.571647 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-38ad3164-370d-451c-84cc-5db52aed27da tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:00.577757 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38ad3164-370d-451c-84cc-5db52aed27da tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:00.578204 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38ad3164-370d-451c-84cc-5db52aed27da tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:00.579237 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38ad3164-370d-451c-84cc-5db52aed27da tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:00.579695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38ad3164-370d-451c-84cc-5db52aed27da tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:00.606352 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:00.611723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-38ad3164-370d-451c-84cc-5db52aed27da tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045804 May 19 14:01:00.612475 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 419/845] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 14:01:00 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:01:01.005334 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d78a9bf9-a915-41e1-be75-567244028f09 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:01.006279 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d78a9bf9-a915-41e1-be75-567244028f09 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:01.012772 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d78a9bf9-a915-41e1-be75-567244028f09 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.013222 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d78a9bf9-a915-41e1-be75-567244028f09 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.013986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d78a9bf9-a915-41e1-be75-567244028f09 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.014423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d78a9bf9-a915-41e1-be75-567244028f09 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.145533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d78a9bf9-a915-41e1-be75-567244028f09 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:01.154208 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d78a9bf9-a915-41e1-be75-567244028f09 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.153250 May 19 14:01:01.155045 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 427/846] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:00 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:01.234473 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f43f20f5-e345-4bd9-be9e-5ec47c0ad213 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:01.235175 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f43f20f5-e345-4bd9-be9e-5ec47c0ad213 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:01.243792 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f43f20f5-e345-4bd9-be9e-5ec47c0ad213 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.244271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f43f20f5-e345-4bd9-be9e-5ec47c0ad213 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.245015 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f43f20f5-e345-4bd9-be9e-5ec47c0ad213 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.245447 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f43f20f5-e345-4bd9-be9e-5ec47c0ad213 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.382715 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f43f20f5-e345-4bd9-be9e-5ec47c0ad213 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:01.392490 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f43f20f5-e345-4bd9-be9e-5ec47c0ad213 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.162314 May 19 14:01:01.393072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 420/847] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:01 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:01.624771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-534a9e39-1a11-418c-905d-19a85a03f93d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:01.625748 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-534a9e39-1a11-418c-905d-19a85a03f93d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:01.632107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-534a9e39-1a11-418c-905d-19a85a03f93d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.632567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-534a9e39-1a11-418c-905d-19a85a03f93d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.633320 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-534a9e39-1a11-418c-905d-19a85a03f93d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.633754 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-534a9e39-1a11-418c-905d-19a85a03f93d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.661756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-534a9e39-1a11-418c-905d-19a85a03f93d tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041077 May 19 14:01:01.662301 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 428/848] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 14:01:01 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 14:01:01.722056 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2a489816-3e32-45c4-8b34-f9c9f03bb237 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:01.722562 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2a489816-3e32-45c4-8b34-f9c9f03bb237 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:01.729169 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2a489816-3e32-45c4-8b34-f9c9f03bb237 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.729637 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2a489816-3e32-45c4-8b34-f9c9f03bb237 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.730473 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2a489816-3e32-45c4-8b34-f9c9f03bb237 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.730942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2a489816-3e32-45c4-8b34-f9c9f03bb237 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.755500 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2a489816-3e32-45c4-8b34-f9c9f03bb237 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:01:01.830016 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2a489816-3e32-45c4-8b34-f9c9f03bb237 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 204 len: 0 microversion: 2.1 time: 0.111510 May 19 14:01:01.830772 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 421/849] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:01:01 2022] DELETE /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:01:01.839994 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e3e86065-3c9c-44d5-945a-8ed766735150 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:01.840619 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e3e86065-3c9c-44d5-945a-8ed766735150 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:01.846628 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e3e86065-3c9c-44d5-945a-8ed766735150 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.847151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e3e86065-3c9c-44d5-945a-8ed766735150 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.847941 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e3e86065-3c9c-44d5-945a-8ed766735150 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:01.848373 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e3e86065-3c9c-44d5-945a-8ed766735150 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:01.976474 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e3e86065-3c9c-44d5-945a-8ed766735150 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:01.984329 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e3e86065-3c9c-44d5-945a-8ed766735150 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1682 microversion: 2.1 time: 0.148898 May 19 14:01:01.984886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 429/850] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:01 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:02.172705 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d7bd0fcb-63b5-4d27-acae-4eadffc6e2cd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:02.173402 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d7bd0fcb-63b5-4d27-acae-4eadffc6e2cd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:02.179351 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7bd0fcb-63b5-4d27-acae-4eadffc6e2cd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:02.179800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7bd0fcb-63b5-4d27-acae-4eadffc6e2cd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:02.180558 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7bd0fcb-63b5-4d27-acae-4eadffc6e2cd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:02.180996 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7bd0fcb-63b5-4d27-acae-4eadffc6e2cd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:02.312813 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d7bd0fcb-63b5-4d27-acae-4eadffc6e2cd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:02.321306 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d7bd0fcb-63b5-4d27-acae-4eadffc6e2cd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.152831 May 19 14:01:02.321869 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 422/851] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:02 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:01:02.409612 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5160d970-a38b-4a67-aa6b-e61a23d68657 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:02.410151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5160d970-a38b-4a67-aa6b-e61a23d68657 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:02.417306 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5160d970-a38b-4a67-aa6b-e61a23d68657 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:02.417758 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5160d970-a38b-4a67-aa6b-e61a23d68657 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:02.418524 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5160d970-a38b-4a67-aa6b-e61a23d68657 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:02.418989 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5160d970-a38b-4a67-aa6b-e61a23d68657 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:02.437037 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:02.555855 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5160d970-a38b-4a67-aa6b-e61a23d68657 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:02.563392 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5160d970-a38b-4a67-aa6b-e61a23d68657 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.157790 May 19 14:01:02.563955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 430/852] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:02 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:03.001467 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-015a7279-f13a-4532-978c-f2940429c300 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:03.002081 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-015a7279-f13a-4532-978c-f2940429c300 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:03.008363 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-015a7279-f13a-4532-978c-f2940429c300 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:03.008808 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-015a7279-f13a-4532-978c-f2940429c300 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:03.009558 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-015a7279-f13a-4532-978c-f2940429c300 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:03.010142 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-015a7279-f13a-4532-978c-f2940429c300 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:03.136368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-015a7279-f13a-4532-978c-f2940429c300 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:03.143994 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-015a7279-f13a-4532-978c-f2940429c300 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1682 microversion: 2.1 time: 0.146403 May 19 14:01:03.144557 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 423/853] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:02 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:03.338184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2732cca7-0ba9-4033-bb0f-c16c17949e00 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:03.338841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2732cca7-0ba9-4033-bb0f-c16c17949e00 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:03.344928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2732cca7-0ba9-4033-bb0f-c16c17949e00 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:03.345378 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2732cca7-0ba9-4033-bb0f-c16c17949e00 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:03.346187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2732cca7-0ba9-4033-bb0f-c16c17949e00 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:03.346621 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2732cca7-0ba9-4033-bb0f-c16c17949e00 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:03.478461 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2732cca7-0ba9-4033-bb0f-c16c17949e00 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:03.486936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2732cca7-0ba9-4033-bb0f-c16c17949e00 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.152526 May 19 14:01:03.487629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 431/854] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:03 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:03.580794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ef60b27f-d27f-48f3-9d08-ca6a0cef7372 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:03.581584 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ef60b27f-d27f-48f3-9d08-ca6a0cef7372 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:03.587930 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef60b27f-d27f-48f3-9d08-ca6a0cef7372 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:03.588402 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef60b27f-d27f-48f3-9d08-ca6a0cef7372 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:03.589176 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef60b27f-d27f-48f3-9d08-ca6a0cef7372 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:03.589615 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef60b27f-d27f-48f3-9d08-ca6a0cef7372 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:03.721206 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ef60b27f-d27f-48f3-9d08-ca6a0cef7372 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:03.729400 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ef60b27f-d27f-48f3-9d08-ca6a0cef7372 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.151961 May 19 14:01:03.733896 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 424/855] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:03 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:04.161542 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6d0c0863-1b8d-40b2-8f0e-4bdab602a39b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:04.162180 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6d0c0863-1b8d-40b2-8f0e-4bdab602a39b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:04.168250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6d0c0863-1b8d-40b2-8f0e-4bdab602a39b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:04.168732 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6d0c0863-1b8d-40b2-8f0e-4bdab602a39b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:04.169499 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6d0c0863-1b8d-40b2-8f0e-4bdab602a39b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:04.169957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6d0c0863-1b8d-40b2-8f0e-4bdab602a39b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:04.232956 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-6d0c0863-1b8d-40b2-8f0e-4bdab602a39b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc3e0105f2a472092423852b1f39979', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b4336043d5446b922432a2f43af17a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:04.241916 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6d0c0863-1b8d-40b2-8f0e-4bdab602a39b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 200 len: 1615 microversion: 2.1 time: 0.084208 May 19 14:01:04.242504 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 432/856] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:04 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 1615 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:04.299777 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-ee5395c7-65d0-4474-a6fd-64f40c57bb63 req-0a612319-dceb-4980-bb66-70ea4429a9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e497045-70f8-4a86-9e3f-e1ecf7ac607a", "name": "network-vif-deleted", "tag": "218713eb-c739-4649-b32f-d91de1913518"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:01:04.310674 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ee5395c7-65d0-4474-a6fd-64f40c57bb63 req-0a612319-dceb-4980-bb66-70ea4429a9ac service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:04.311138 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ee5395c7-65d0-4474-a6fd-64f40c57bb63 req-0a612319-dceb-4980-bb66-70ea4429a9ac service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:04.324167 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-ee5395c7-65d0-4474-a6fd-64f40c57bb63 req-0a612319-dceb-4980-bb66-70ea4429a9ac service nova] Creating event network-vif-deleted:218713eb-c739-4649-b32f-d91de1913518 for instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a on hv-cinder-78481 May 19 14:01:04.329732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-ee5395c7-65d0-4474-a6fd-64f40c57bb63 req-0a612319-dceb-4980-bb66-70ea4429a9ac service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033700 May 19 14:01:04.330686 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 425/857] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:01:04.503973 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-013aa3e1-b8fa-4028-9f69-b2c832578581 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:04.505221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-013aa3e1-b8fa-4028-9f69-b2c832578581 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:04.512725 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-013aa3e1-b8fa-4028-9f69-b2c832578581 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:04.513442 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-013aa3e1-b8fa-4028-9f69-b2c832578581 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:04.514405 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-013aa3e1-b8fa-4028-9f69-b2c832578581 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:04.514872 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-013aa3e1-b8fa-4028-9f69-b2c832578581 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:04.651173 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-013aa3e1-b8fa-4028-9f69-b2c832578581 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:04.659184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-013aa3e1-b8fa-4028-9f69-b2c832578581 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.159190 May 19 14:01:04.659761 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 433/858] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:04 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:04.746731 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c779c56f-dc7e-47f7-8030-33e70136ac01 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:04.747468 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c779c56f-dc7e-47f7-8030-33e70136ac01 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:04.755819 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c779c56f-dc7e-47f7-8030-33e70136ac01 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:04.756619 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c779c56f-dc7e-47f7-8030-33e70136ac01 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:04.757682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c779c56f-dc7e-47f7-8030-33e70136ac01 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:04.758339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c779c56f-dc7e-47f7-8030-33e70136ac01 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:04.913617 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c779c56f-dc7e-47f7-8030-33e70136ac01 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:04.921412 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c779c56f-dc7e-47f7-8030-33e70136ac01 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.179168 May 19 14:01:04.921983 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 426/859] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:04 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:05.258390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:05.259052 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:05.265697 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:05.266153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:05.266959 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:05.267428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:05.282272 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a HTTP/1.1 May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:05.284104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:05.285810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '3e497045-70f8-4a86-9e3f-e1ecf7ac607a'} May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:05.286820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:05.288146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:05.289491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:05.289491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0ed99359-8924-4a8e-b9c5-a8c457ea6147 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 404 len: 111 microversion: 2.1 time: 0.031306 May 19 14:01:05.289491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 434/860] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:05 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:01:05.294424 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8e2a2c80-a9ae-4381-a279-0b9efac38322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '.version_select at 0x7f5de1c6b430>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:05.313643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8e2a2c80-a9ae-4381-a279-0b9efac38322 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493176811" status: 202 len: 0 microversion: 2.1 time: 0.023089 May 19 14:01:05.314247 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 427/861] 10.222.0.52 () {58 vars in 1220 bytes} [Thu May 19 14:01:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1493176811 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 14:01:05.676316 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c330c3db-9c4d-43be-8850-981580618f83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:05.676937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c330c3db-9c4d-43be-8850-981580618f83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:05.684189 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c330c3db-9c4d-43be-8850-981580618f83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:05.684651 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c330c3db-9c4d-43be-8850-981580618f83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:05.685427 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c330c3db-9c4d-43be-8850-981580618f83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:05.685868 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c330c3db-9c4d-43be-8850-981580618f83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:05.861638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c330c3db-9c4d-43be-8850-981580618f83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:05.870022 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c330c3db-9c4d-43be-8850-981580618f83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.197500 May 19 14:01:05.870603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 435/862] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:05 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:05.937986 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-54ce5a4b-17df-4c1a-a62a-9398862f3387 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:05.938771 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-54ce5a4b-17df-4c1a-a62a-9398862f3387 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:05.945557 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-54ce5a4b-17df-4c1a-a62a-9398862f3387 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:05.946079 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-54ce5a4b-17df-4c1a-a62a-9398862f3387 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:05.946944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-54ce5a4b-17df-4c1a-a62a-9398862f3387 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:05.947735 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-54ce5a4b-17df-4c1a-a62a-9398862f3387 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:06.084892 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-54ce5a4b-17df-4c1a-a62a-9398862f3387 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:06.095302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-54ce5a4b-17df-4c1a-a62a-9398862f3387 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.161116 May 19 14:01:06.095876 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 428/863] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:05 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:06.888627 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e6c6d528-dbf9-4b9a-ab7b-29745e9c4464 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:06.889242 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e6c6d528-dbf9-4b9a-ab7b-29745e9c4464 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:06.891601 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=66 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:06.897144 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e6c6d528-dbf9-4b9a-ab7b-29745e9c4464 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:06.897597 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e6c6d528-dbf9-4b9a-ab7b-29745e9c4464 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:06.898359 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e6c6d528-dbf9-4b9a-ab7b-29745e9c4464 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:06.898802 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e6c6d528-dbf9-4b9a-ab7b-29745e9c4464 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:07.029165 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e6c6d528-dbf9-4b9a-ab7b-29745e9c4464 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:07.037205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e6c6d528-dbf9-4b9a-ab7b-29745e9c4464 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.153155 May 19 14:01:07.037767 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 436/864] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:06 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:07.112571 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3bd565c5-da49-4a32-8bd7-18dba41ddb6a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:07.113258 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3bd565c5-da49-4a32-8bd7-18dba41ddb6a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:07.120882 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3bd565c5-da49-4a32-8bd7-18dba41ddb6a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:07.121330 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3bd565c5-da49-4a32-8bd7-18dba41ddb6a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:07.122108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3bd565c5-da49-4a32-8bd7-18dba41ddb6a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:07.122544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3bd565c5-da49-4a32-8bd7-18dba41ddb6a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:07.131605 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:07.132111 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:07.138251 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:07.138709 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:07.139509 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:07.139955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:07.153281 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a HTTP/1.1 May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:07.154905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.156463 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '3e497045-70f8-4a86-9e3f-e1ecf7ac607a'} May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:07.157258 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.158453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.159727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:07.159727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f517e25e-e775-4828-874b-9c0afc6d34e8 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 404 len: 111 microversion: 2.1 time: 0.028814 May 19 14:01:07.159727 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 437/865] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:01:07 2022] DELETE /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 14:01:07.164322 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:07.164938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 3e497045-70f8-4a86-9e3f-e1ecf7ac607a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:07.171519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:07.171972 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:07.172748 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:07.173195 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:07.187356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a HTTP/1.1 May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:07.189170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.191937 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '3e497045-70f8-4a86-9e3f-e1ecf7ac607a'} May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:07.193464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. May 19 14:01:07.196051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:07.198506 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 3e497045-70f8-4a86-9e3f-e1ecf7ac607a could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:07.198506 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-27453368-5861-49e0-862d-09d3ea12a3cb tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a" status: 404 len: 111 microversion: 2.1 time: 0.029836 May 19 14:01:07.198506 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 438/866] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:07 2022] GET /compute/v2.1/servers/3e497045-70f8-4a86-9e3f-e1ecf7ac607a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:01:07.260927 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3bd565c5-da49-4a32-8bd7-18dba41ddb6a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:07.269807 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3bd565c5-da49-4a32-8bd7-18dba41ddb6a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.160156 May 19 14:01:07.269807 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 429/867] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:07 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:08.054665 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f92fcf97-06d8-4eb1-9a88-31631fe19595 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:08.055323 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f92fcf97-06d8-4eb1-9a88-31631fe19595 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:08.062511 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f92fcf97-06d8-4eb1-9a88-31631fe19595 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.063025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f92fcf97-06d8-4eb1-9a88-31631fe19595 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.063798 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f92fcf97-06d8-4eb1-9a88-31631fe19595 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.064243 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f92fcf97-06d8-4eb1-9a88-31631fe19595 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.192170 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f92fcf97-06d8-4eb1-9a88-31631fe19595 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:08.200751 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f92fcf97-06d8-4eb1-9a88-31631fe19595 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.150009 May 19 14:01:08.201316 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 439/868] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:08 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:08.285374 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9caaabb2-a5bd-4626-a43c-4c2ea720c5e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:08.285982 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9caaabb2-a5bd-4626-a43c-4c2ea720c5e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:08.292628 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9caaabb2-a5bd-4626-a43c-4c2ea720c5e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.293073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9caaabb2-a5bd-4626-a43c-4c2ea720c5e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.293825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9caaabb2-a5bd-4626-a43c-4c2ea720c5e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.294486 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9caaabb2-a5bd-4626-a43c-4c2ea720c5e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.335785 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:08.336287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:08.342425 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.342905 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.343696 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.344132 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.358590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe HTTP/1.1 May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:08.360205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.361609 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '0c2be2ac-8751-4467-9d51-1eee62e05dbe'} May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:08.364579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.365813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.367012 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:08.367012 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3533c9d7-2ac9-491b-8f1f-66d3349e0566 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 404 len: 111 microversion: 2.1 time: 0.029794 May 19 14:01:08.367012 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 440/869] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:01:08 2022] DELETE /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 14:01:08.371139 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:08.371886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 0c2be2ac-8751-4467-9d51-1eee62e05dbe] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:08.378126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.378630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.379376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.379824 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.394846 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe HTTP/1.1 May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:08.396430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.397698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '0c2be2ac-8751-4467-9d51-1eee62e05dbe'} May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:08.398531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. May 19 14:01:08.400181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.401998 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 0c2be2ac-8751-4467-9d51-1eee62e05dbe could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:08.401998 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-93173493-d205-4cc2-9c90-e04619aa5181 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe" status: 404 len: 111 microversion: 2.1 time: 0.031796 May 19 14:01:08.401998 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 441/870] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:08 2022] GET /compute/v2.1/servers/0c2be2ac-8751-4467-9d51-1eee62e05dbe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:01:08.406260 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:08.406755 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:08.412831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.413316 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.414085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.414525 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.428070 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 HTTP/1.1 May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:08.429630 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.431158 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4'} May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:08.432421 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.433952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.435137 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:08.435137 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5a3fccf7-c5a7-4783-85ed-8dfa0991ba8b tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 404 len: 111 microversion: 2.1 time: 0.028465 May 19 14:01:08.435282 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 442/871] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:01:08 2022] DELETE /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 14:01:08.435357 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9caaabb2-a5bd-4626-a43c-4c2ea720c5e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:08.439782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:08.440395 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:08.443465 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9caaabb2-a5bd-4626-a43c-4c2ea720c5e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.161772 May 19 14:01:08.444034 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 430/872] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:08 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:08.446229 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.446685 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.448187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:08.448636 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:08.461751 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 HTTP/1.1 May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:08.463450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.464936 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4'} May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:08.465752 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. May 19 14:01:08.466957 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:08.468039 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:08.468039 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b92acf60-059a-4b3c-abf9-c690407921db tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4" status: 404 len: 111 microversion: 2.1 time: 0.028698 May 19 14:01:08.468039 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 443/873] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:08 2022] GET /compute/v2.1/servers/7ada6b8d-46b9-4ddc-93d4-3424f0e0eab4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:01:09.217809 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d867c356-5eb9-44e9-bda1-2629c01ac838 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:09.218642 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d867c356-5eb9-44e9-bda1-2629c01ac838 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:09.224822 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d867c356-5eb9-44e9-bda1-2629c01ac838 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:09.225280 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d867c356-5eb9-44e9-bda1-2629c01ac838 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:09.226071 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d867c356-5eb9-44e9-bda1-2629c01ac838 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:09.226516 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d867c356-5eb9-44e9-bda1-2629c01ac838 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:09.354999 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d867c356-5eb9-44e9-bda1-2629c01ac838 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:09.363208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d867c356-5eb9-44e9-bda1-2629c01ac838 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.149194 May 19 14:01:09.363785 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 431/874] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:09 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:09.461309 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2f472162-c80e-4769-a2cf-b27b01bfe985 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:09.461919 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2f472162-c80e-4769-a2cf-b27b01bfe985 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:09.469109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2f472162-c80e-4769-a2cf-b27b01bfe985 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:09.469563 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2f472162-c80e-4769-a2cf-b27b01bfe985 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:09.470337 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2f472162-c80e-4769-a2cf-b27b01bfe985 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:09.470776 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2f472162-c80e-4769-a2cf-b27b01bfe985 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:09.599156 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:09.599658 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:09.606570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:09.607050 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:09.607179 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2f472162-c80e-4769-a2cf-b27b01bfe985 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:09.607823 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:09.608260 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:09.614848 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2f472162-c80e-4769-a2cf-b27b01bfe985 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.157369 May 19 14:01:09.615449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 444/875] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:09 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:09.622234 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec HTTP/1.1 May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:01:09.623938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.625457 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '2e425ccc-4508-4267-bc69-5590c1f503ec'} May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:09.626302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.627540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:09.629261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:09.629261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-59ea6972-8f86-4b07-96e7-1e66836a8d79 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 404 len: 111 microversion: 2.1 time: 0.030098 May 19 14:01:09.629261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 432/876] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:01:09 2022] DELETE /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 14:01:09.633834 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:09.634450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] [instance: 2e425ccc-4508-4267-bc69-5590c1f503ec] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:09.640995 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:09.641448 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:09.642216 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:09.642664 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:09.657127 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] HTTP exception thrown: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Request method failure captured: May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec HTTP/1.1 May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwUxtgBwZ4wyhABKBTAAR3yzo2H-qDJHWGddhs3AKe4LRHVjXum20P7aa4bLic5uVFIoiLkOttdHsOqOhfrsurPcxa_tdgI5hrCfDF1XlV0KubTOLw33uCe5Km7ULJRuiAPVPn4AUqiDAd3pFOUJUxjkszNJMT3QRa9y759KaKH3ik May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:09.658658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_89b4336043d5446b922432a2f43af17a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/89b4336043d5446b922432a2f43af17a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/89b4336043d5446b922432a2f43af17a"}]}] May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 89b4336043d5446b922432a2f43af17a May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1102814422 May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 0cc3e0105f2a472092423852b1f39979 May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeNegativeTest-1102814422-project May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.660224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '2e425ccc-4508-4267-bc69-5590c1f503ec'} May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:09.661128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. May 19 14:01:09.662297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:09.663407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] Returning 404 to user: Instance 2e425ccc-4508-4267-bc69-5590c1f503ec could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:09.663407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b210000b-8635-45db-938e-a41661169712 tempest-AttachVolumeNegativeTest-1102814422 tempest-AttachVolumeNegativeTest-1102814422-project] 10.222.0.52 "GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec" status: 404 len: 111 microversion: 2.1 time: 0.030313 May 19 14:01:09.663407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 445/877] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:09 2022] GET /compute/v2.1/servers/2e425ccc-4508-4267-bc69-5590c1f503ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:01:10.381372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a1cfeca7-eb20-45db-bd19-249d9fcdeed5 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:10.382019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a1cfeca7-eb20-45db-bd19-249d9fcdeed5 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:10.389545 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a1cfeca7-eb20-45db-bd19-249d9fcdeed5 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:10.389999 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a1cfeca7-eb20-45db-bd19-249d9fcdeed5 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:10.390782 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a1cfeca7-eb20-45db-bd19-249d9fcdeed5 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:10.391245 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a1cfeca7-eb20-45db-bd19-249d9fcdeed5 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:10.520981 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a1cfeca7-eb20-45db-bd19-249d9fcdeed5 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:10.529883 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a1cfeca7-eb20-45db-bd19-249d9fcdeed5 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.152730 May 19 14:01:10.535652 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 433/878] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:10 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:10.632410 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-90e265f2-df59-4938-a928-a632252afbe8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:10.633041 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-90e265f2-df59-4938-a928-a632252afbe8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:10.640873 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-90e265f2-df59-4938-a928-a632252afbe8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:10.641332 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-90e265f2-df59-4938-a928-a632252afbe8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:10.642125 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-90e265f2-df59-4938-a928-a632252afbe8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:10.642571 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-90e265f2-df59-4938-a928-a632252afbe8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:10.792060 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-90e265f2-df59-4938-a928-a632252afbe8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:10.799820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-90e265f2-df59-4938-a928-a632252afbe8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.171506 May 19 14:01:10.800450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 446/879] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:10 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:11.022689 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-d5bad32a-55d1-4d6c-85cd-2f249594ab76 req-a7ad1b82-3673-45f3-bb2d-997d0910506e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccab6e9-3133-4db9-a8d9-27c83353c00a", "name": "network-vif-plugged", "status": "completed", "tag": "80eac5d4-3a31-4ac5-b15f-b7109c704ba1"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:01:11.044735 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-d5bad32a-55d1-4d6c-85cd-2f249594ab76 req-a7ad1b82-3673-45f3-bb2d-997d0910506e service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:11.056078 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-d5bad32a-55d1-4d6c-85cd-2f249594ab76 req-a7ad1b82-3673-45f3-bb2d-997d0910506e service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:11.076348 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-d5bad32a-55d1-4d6c-85cd-2f249594ab76 req-a7ad1b82-3673-45f3-bb2d-997d0910506e service nova] Creating event network-vif-plugged:80eac5d4-3a31-4ac5-b15f-b7109c704ba1 for instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a on hv-cinder-78481 May 19 14:01:11.083341 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-d5bad32a-55d1-4d6c-85cd-2f249594ab76 req-a7ad1b82-3673-45f3-bb2d-997d0910506e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064282 May 19 14:01:11.084182 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 434/880] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:01:11.547502 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f2b3335c-825c-43e5-9d85-02268f5c4a0f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:11.548283 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f2b3335c-825c-43e5-9d85-02268f5c4a0f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:11.554415 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2b3335c-825c-43e5-9d85-02268f5c4a0f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:11.555285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2b3335c-825c-43e5-9d85-02268f5c4a0f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:11.556339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2b3335c-825c-43e5-9d85-02268f5c4a0f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:11.557759 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f2b3335c-825c-43e5-9d85-02268f5c4a0f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:11.699920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f2b3335c-825c-43e5-9d85-02268f5c4a0f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:11.709534 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f2b3335c-825c-43e5-9d85-02268f5c4a0f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.166121 May 19 14:01:11.710325 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 447/881] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:11 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:11.818285 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bc048384-a883-4112-b987-3b227766cc98 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:11.819750 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bc048384-a883-4112-b987-3b227766cc98 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:11.827079 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc048384-a883-4112-b987-3b227766cc98 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:11.827628 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc048384-a883-4112-b987-3b227766cc98 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:11.828487 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc048384-a883-4112-b987-3b227766cc98 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:11.829111 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc048384-a883-4112-b987-3b227766cc98 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:11.991145 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bc048384-a883-4112-b987-3b227766cc98 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:11.999206 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bc048384-a883-4112-b987-3b227766cc98 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1576 microversion: 2.1 time: 0.185846 May 19 14:01:11.999787 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 435/882] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:11 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:12.727940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-698482cb-c43c-4c2f-a50d-364d00080f40 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:12.728432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-698482cb-c43c-4c2f-a50d-364d00080f40 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:12.735356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-698482cb-c43c-4c2f-a50d-364d00080f40 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:12.735860 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-698482cb-c43c-4c2f-a50d-364d00080f40 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:12.736631 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-698482cb-c43c-4c2f-a50d-364d00080f40 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:12.737090 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-698482cb-c43c-4c2f-a50d-364d00080f40 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:12.974881 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-698482cb-c43c-4c2f-a50d-364d00080f40 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:12.984616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-698482cb-c43c-4c2f-a50d-364d00080f40 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.260778 May 19 14:01:12.995393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 448/883] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:12 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:13.017094 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5671ce2e-8c5e-45c2-8cb1-adc824bcbef2 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:13.017714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5671ce2e-8c5e-45c2-8cb1-adc824bcbef2 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:13.029883 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5671ce2e-8c5e-45c2-8cb1-adc824bcbef2 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:13.030342 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5671ce2e-8c5e-45c2-8cb1-adc824bcbef2 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:13.031173 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5671ce2e-8c5e-45c2-8cb1-adc824bcbef2 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:13.031746 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5671ce2e-8c5e-45c2-8cb1-adc824bcbef2 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:13.209898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5671ce2e-8c5e-45c2-8cb1-adc824bcbef2 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:13.218384 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5671ce2e-8c5e-45c2-8cb1-adc824bcbef2 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1563 microversion: 2.1 time: 0.205676 May 19 14:01:13.218957 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 436/884] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:13 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1563 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:01:14.001568 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9fde5497-8352-4ca3-9b49-9da9dd42bfc4 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:14.002204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9fde5497-8352-4ca3-9b49-9da9dd42bfc4 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:14.008992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9fde5497-8352-4ca3-9b49-9da9dd42bfc4 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:14.009446 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9fde5497-8352-4ca3-9b49-9da9dd42bfc4 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:14.011586 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9fde5497-8352-4ca3-9b49-9da9dd42bfc4 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:14.012005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9fde5497-8352-4ca3-9b49-9da9dd42bfc4 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:14.158724 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9fde5497-8352-4ca3-9b49-9da9dd42bfc4 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:14.167850 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9fde5497-8352-4ca3-9b49-9da9dd42bfc4 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1723 microversion: 2.1 time: 0.170071 May 19 14:01:14.168428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 449/885] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:13 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:15.186305 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-871bc1c9-2452-409c-9522-c8d2039ba347 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:15.186957 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-871bc1c9-2452-409c-9522-c8d2039ba347 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:15.194625 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-871bc1c9-2452-409c-9522-c8d2039ba347 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:15.195106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-871bc1c9-2452-409c-9522-c8d2039ba347 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:15.196497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-871bc1c9-2452-409c-9522-c8d2039ba347 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:15.196935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-871bc1c9-2452-409c-9522-c8d2039ba347 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:15.359505 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-871bc1c9-2452-409c-9522-c8d2039ba347 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:15.363056 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:15.367985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-871bc1c9-2452-409c-9522-c8d2039ba347 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1700 microversion: 2.1 time: 0.186469 May 19 14:01:15.368560 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 437/886] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:15 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1700 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:15.385635 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0e48fc1a-b995-4418-b436-668e0147aa33 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:01:15.392439 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0e48fc1a-b995-4418-b436-668e0147aa33 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:15.392906 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0e48fc1a-b995-4418-b436-668e0147aa33 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:15.458755 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0e48fc1a-b995-4418-b436-668e0147aa33 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Going to try to start instance {{(pid=123751) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 14:01:15.502822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0e48fc1a-b995-4418-b436-668e0147aa33 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/action" status: 202 len: 0 microversion: 2.1 time: 0.121205 May 19 14:01:15.503558 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 450/887] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 14:01:15 2022] POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:01:15.513903 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1d99e4f5-a097-4d0d-a428-0030f200a84b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:15.514965 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1d99e4f5-a097-4d0d-a428-0030f200a84b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:15.524909 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1d99e4f5-a097-4d0d-a428-0030f200a84b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:15.526459 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1d99e4f5-a097-4d0d-a428-0030f200a84b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:15.527432 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1d99e4f5-a097-4d0d-a428-0030f200a84b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:15.527979 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1d99e4f5-a097-4d0d-a428-0030f200a84b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:15.674177 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1d99e4f5-a097-4d0d-a428-0030f200a84b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:15.683314 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1d99e4f5-a097-4d0d-a428-0030f200a84b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1709 microversion: 2.1 time: 0.174933 May 19 14:01:15.684210 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 438/888] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:15 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1709 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:16.702168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-da1fc689-0dd9-4a3c-af09-b92c6b8080ac tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:16.702845 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-da1fc689-0dd9-4a3c-af09-b92c6b8080ac tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:16.709302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-da1fc689-0dd9-4a3c-af09-b92c6b8080ac tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:16.709759 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-da1fc689-0dd9-4a3c-af09-b92c6b8080ac tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:16.710567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-da1fc689-0dd9-4a3c-af09-b92c6b8080ac tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:16.711040 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-da1fc689-0dd9-4a3c-af09-b92c6b8080ac tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:16.730163 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:16.853033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-da1fc689-0dd9-4a3c-af09-b92c6b8080ac tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:16.862156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-da1fc689-0dd9-4a3c-af09-b92c6b8080ac tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1709 microversion: 2.1 time: 0.165468 May 19 14:01:16.863181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 451/889] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:16 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:17.879514 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-db9a10e1-aec7-491e-bc9c-b09534988d68 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:17.880169 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-db9a10e1-aec7-491e-bc9c-b09534988d68 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:17.887050 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db9a10e1-aec7-491e-bc9c-b09534988d68 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:17.887501 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db9a10e1-aec7-491e-bc9c-b09534988d68 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:17.888271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db9a10e1-aec7-491e-bc9c-b09534988d68 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:17.888708 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-db9a10e1-aec7-491e-bc9c-b09534988d68 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:18.028524 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-db9a10e1-aec7-491e-bc9c-b09534988d68 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:18.036886 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-db9a10e1-aec7-491e-bc9c-b09534988d68 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1713 microversion: 2.1 time: 0.161418 May 19 14:01:18.037749 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 439/890] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:17 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1713 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:28.831033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2675edf8-33c5-4596-aac8-4d35271dbacd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:28.832055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2675edf8-33c5-4596-aac8-4d35271dbacd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:28.834621 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=31 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:28.835286 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:28.842165 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2675edf8-33c5-4596-aac8-4d35271dbacd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:28.842641 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2675edf8-33c5-4596-aac8-4d35271dbacd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:28.843438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2675edf8-33c5-4596-aac8-4d35271dbacd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:28.843881 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2675edf8-33c5-4596-aac8-4d35271dbacd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:28.872366 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2675edf8-33c5-4596-aac8-4d35271dbacd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045348 May 19 14:01:28.872914 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 452/891] 10.222.0.52 () {60 vars in 1342 bytes} [Thu May 19 14:01:28 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:28.930314 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b794bf3f-cac9-4301-ba60-4f61c051d85c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:28.930850 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b794bf3f-cac9-4301-ba60-4f61c051d85c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:28.933417 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:28.934164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=13 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:28.941316 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b794bf3f-cac9-4301-ba60-4f61c051d85c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:28.941773 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b794bf3f-cac9-4301-ba60-4f61c051d85c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:28.942544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b794bf3f-cac9-4301-ba60-4f61c051d85c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:28.943028 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b794bf3f-cac9-4301-ba60-4f61c051d85c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:28.968922 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b794bf3f-cac9-4301-ba60-4f61c051d85c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:01:29.045147 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b794bf3f-cac9-4301-ba60-4f61c051d85c tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 204 len: 0 microversion: 2.20 time: 0.118322 May 19 14:01:29.045647 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 440/892] 10.222.0.52 () {60 vars in 1279 bytes} [Thu May 19 14:01:28 2022] DELETE /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 14:01:29.054837 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:29.056166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:29.062922 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:29.063381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:29.064150 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:29.064710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:29.200754 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:29.209178 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:29.210681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:29.211873 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-969fe88a-ec00-46d4-a60d-3e5e5957033a tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.161743 May 19 14:01:29.212451 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 453/893] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:01:29 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:01:30.231233 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:30.231937 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:30.238596 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:30.239135 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:30.239896 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:30.240423 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:30.369687 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:30.379088 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:30.380592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:30.382011 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cd95fc75-e22d-426a-b3dd-eb0e4903740b tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.155541 May 19 14:01:30.382558 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 441/894] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:01:30 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:01:31.401519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:31.402228 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:31.421938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:31.422369 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:31.423187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:31.423617 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:31.560322 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:31.571100 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:31.572713 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '00b21c3634cc41aca680152740644168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eed7a893f7b42edaadbf898ebe16cd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:31.574020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-43644dfa-1161-4146-9ab6-4a473135cdc1 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 200 len: 1723 microversion: 2.20 time: 0.176607 May 19 14:01:31.576286 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 454/895] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:01:31 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 14:01:31.831047 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-6c7a6706-1400-4eb7-afc4-7bba60b636df req-84d47f6c-7723-4a5e-ac38-48d7f47b6d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea89fb6-a6ad-4aaf-9c6a-c06816051a96", "name": "network-vif-deleted", "tag": "b57d1bfa-eb18-42d5-a8b6-81fae3792bb9"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:01:31.839710 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-6c7a6706-1400-4eb7-afc4-7bba60b636df req-84d47f6c-7723-4a5e-ac38-48d7f47b6d82 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:31.841302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-6c7a6706-1400-4eb7-afc4-7bba60b636df req-84d47f6c-7723-4a5e-ac38-48d7f47b6d82 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:31.853465 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-6c7a6706-1400-4eb7-afc4-7bba60b636df req-84d47f6c-7723-4a5e-ac38-48d7f47b6d82 service nova] Creating event network-vif-deleted:b57d1bfa-eb18-42d5-a8b6-81fae3792bb9 for instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 on hv-cinder-78481 May 19 14:01:31.865227 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-6c7a6706-1400-4eb7-afc4-7bba60b636df req-84d47f6c-7723-4a5e-ac38-48d7f47b6d82 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037684 May 19 14:01:31.870685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 442/896] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:01:32.593366 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:32.594221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:32.601065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:32.601515 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:32.602275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:32.602704 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:32.616280 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] HTTP exception thrown: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Request method failure captured: May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 HTTP/1.1 May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwT3QrnXodQhRSeSKg8o6b6b6gxWCTyjzATRo9jhLGjOCIquFLRqL97kJsEkNGCphotEQ6Op5IYXxf_jLe9qmDYMkfhmIrBnPmYniLfJezXIq__6Z7a96jz9OhFe6Uiscx14NcOWLccXjG67yfDaUJYoiUttAdbNjkTy6XTGYdhPC8 May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Openstack-Nova-Api-Version: 2.20 May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:32.618341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}] May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 00b21c3634cc41aca680152740644168 May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:32.619814 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '4ea89fb6-a6ad-4aaf-9c6a-c06816051a96'} May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:32.620594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:32.623221 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:32.624900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Returning 404 to user: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:32.624900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d08e311a-2410-4f46-a56e-558f73e01bb3 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 404 len: 111 microversion: 2.20 time: 0.030909 May 19 14:01:32.629249 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0f790fa6-2e04-496c-8729-30ac847e93fd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '.version_select at 0x7f5de1c27670>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:32.632280 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 455/897] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:01:32 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 14:01:32.650245 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0f790fa6-2e04-496c-8729-30ac847e93fd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547581664" status: 204 len: 0 microversion: 2.20 time: 0.025050 May 19 14:01:32.651732 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 443/898] 10.222.0.52 () {60 vars in 1258 bytes} [Thu May 19 14:01:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547581664 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 14:01:34.492282 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:34.492871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:34.500356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:34.500808 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:34.501646 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:34.502117 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:34.515639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] HTTP exception thrown: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Request method failure captured: May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 HTTP/1.1 May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwT3QrnXodQhRSeSKg8o6b6b6gxWCTyjzATRo9jhLGjOCIquFLRqL97kJsEkNGCphotEQ6Op5IYXxf_jLe9qmDYMkfhmIrBnPmYniLfJezXIq__6Z7a96jz9OhFe6Uiscx14NcOWLccXjG67yfDaUJYoiUttAdbNjkTy6XTGYdhPC8 May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Openstack-Nova-Api-Version: 2.20 May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:34.517181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}] May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 00b21c3634cc41aca680152740644168 May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.518829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '4ea89fb6-a6ad-4aaf-9c6a-c06816051a96'} May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:34.520423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.521866 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:34.524033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Returning 404 to user: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:34.524033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b488b053-416e-4b19-a5d9-393daa455ecd tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 404 len: 111 microversion: 2.20 time: 0.031081 May 19 14:01:34.524033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 456/899] 10.222.0.52 () {60 vars in 1279 bytes} [Thu May 19 14:01:34 2022] DELETE /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 14:01:34.528577 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:34.529339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:34.535557 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:34.535998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:34.536768 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:34.537283 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:34.551630 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] HTTP exception thrown: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Request method failure captured: May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 HTTP/1.1 May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwT3QrnXodQhRSeSKg8o6b6b6gxWCTyjzATRo9jhLGjOCIquFLRqL97kJsEkNGCphotEQ6Op5IYXxf_jLe9qmDYMkfhmIrBnPmYniLfJezXIq__6Z7a96jz9OhFe6Uiscx14NcOWLccXjG67yfDaUJYoiUttAdbNjkTy6XTGYdhPC8 May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Openstack-Nova-Api-Version: 2.20 May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:01:34.553275 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}] May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: 00b21c3634cc41aca680152740644168 May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.554917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '4ea89fb6-a6ad-4aaf-9c6a-c06816051a96'} May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:34.555716 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. May 19 14:01:34.556898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:34.557991 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Returning 404 to user: Instance 4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:34.557991 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b795be7a-d7f4-483f-a2ad-85266d06416d tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96" status: 404 len: 111 microversion: 2.20 time: 0.031227 May 19 14:01:34.557991 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 444/900] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:01:34 2022] GET /compute/v2.1/servers/4ea89fb6-a6ad-4aaf-9c6a-c06816051a96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 14:01:35.688213 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:35.688750 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:35.695223 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:35.695677 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:35.696444 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:35.696884 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:35.709881 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] HTTP exception thrown: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Request method failure captured: May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 HTTP/1.1 May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihkwT3QrnXodQhRSeSKg8o6b6b6gxWCTyjzATRo9jhLGjOCIquFLRqL97kJsEkNGCphotEQ6Op5IYXxf_jLe9qmDYMkfhmIrBnPmYniLfJezXIq__6Z7a96jz9OhFe6Uiscx14NcOWLccXjG67yfDaUJYoiUttAdbNjkTy6XTGYdhPC8 May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Openstack-Nova-Api-Version: 2.20 May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:01:35.711449 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}] May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 00b21c3634cc41aca680152740644168 May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.713005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '5c4e2c2f-4753-4911-8859-73736543f959'} May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:35.713917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.715460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:01:35.716909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Returning 404 to user: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:35.716909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-42d0b58d-ac7e-4956-aa90-231f229a87fb tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 404 len: 111 microversion: 2.20 time: 0.029111 May 19 14:01:35.716909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 457/901] 10.222.0.52 () {60 vars in 1279 bytes} [Thu May 19 14:01:35 2022] DELETE /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 14:01:35.721393 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:35.722006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] [instance: 5c4e2c2f-4753-4911-8859-73736543f959] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:35.728477 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:35.728926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:35.729688 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:35.730128 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:35.743686 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] HTTP exception thrown: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Request method failure captured: May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 HTTP/1.1 May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihkwT3QrnXodQhRSeSKg8o6b6b6gxWCTyjzATRo9jhLGjOCIquFLRqL97kJsEkNGCphotEQ6Op5IYXxf_jLe9qmDYMkfhmIrBnPmYniLfJezXIq__6Z7a96jz9OhFe6Uiscx14NcOWLccXjG67yfDaUJYoiUttAdbNjkTy6XTGYdhPC8 May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Openstack-Nova-Api-Version: 2.20 May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:01:35.745221 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4eed7a893f7b42edaadbf898ebe16cd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4eed7a893f7b42edaadbf898ebe16cd6"}]}] May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 4eed7a893f7b42edaadbf898ebe16cd6 May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1896072134 May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: 00b21c3634cc41aca680152740644168 May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1896072134-project May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.747573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '5c4e2c2f-4753-4911-8859-73736543f959'} May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:01:35.751765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. May 19 14:01:35.753667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:01:35.755059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] Returning 404 to user: Instance 5c4e2c2f-4753-4911-8859-73736543f959 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:01:35.755059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-882351a6-2ed6-4884-9820-83ee066af031 tempest-AttachVolumeShelveTestJSON-1896072134 tempest-AttachVolumeShelveTestJSON-1896072134-project] 10.222.0.52 "GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959" status: 404 len: 111 microversion: 2.20 time: 0.029142 May 19 14:01:35.755059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 445/902] 10.222.0.52 () {60 vars in 1276 bytes} [Thu May 19 14:01:35 2022] GET /compute/v2.1/servers/5c4e2c2f-4753-4911-8859-73736543f959 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 14:01:41.577940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1506038619", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "networks": [{"uuid": "8c8b2849-e551-4065-bc90-6e6a7b094720"}]}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:01:41.632451 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] validate_networks() for [('8c8b2849-e551-4065-bc90-6e6a7b094720', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 14:01:42.439835 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 14:01:42.440261 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 14:01:42.440739 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 14:01:42.441150 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 14:01:42.441747 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 14:01:42.451085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:42.451545 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:42.452356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:42.452798 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:42.470108 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Getting quotas for project f68358e9d695445490f8209d832a1c13. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 14:01:42.474353 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Getting quotas for user 12d3af57f5e34f798336d353a111cefd and project f68358e9d695445490f8209d832a1c13. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 14:01:42.486417 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 14:01:42.488813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 14:01:42.535064 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ca21449e-3bb5-4e15-b25e-7f6f177557d8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.962010 May 19 14:01:42.535876 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 458/903] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 14:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 14:01:42.546417 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0ff333c6-2d29-493e-bb58-73724de4abad tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:42.547065 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0ff333c6-2d29-493e-bb58-73724de4abad tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:42.613323 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0ff333c6-2d29-493e-bb58-73724de4abad tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:42.623134 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0ff333c6-2d29-493e-bb58-73724de4abad tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1219 microversion: 2.1 time: 0.080928 May 19 14:01:42.623807 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 446/904] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:42 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:43.640583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c1d6d0cc-49d1-48e6-a3c6-b294e00bf5d6 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:43.641873 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c1d6d0cc-49d1-48e6-a3c6-b294e00bf5d6 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:43.649639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c1d6d0cc-49d1-48e6-a3c6-b294e00bf5d6 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:43.650450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c1d6d0cc-49d1-48e6-a3c6-b294e00bf5d6 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:43.651502 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c1d6d0cc-49d1-48e6-a3c6-b294e00bf5d6 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:43.652134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c1d6d0cc-49d1-48e6-a3c6-b294e00bf5d6 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:43.718636 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c1d6d0cc-49d1-48e6-a3c6-b294e00bf5d6 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:43.726669 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c1d6d0cc-49d1-48e6-a3c6-b294e00bf5d6 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1289 microversion: 2.1 time: 0.090742 May 19 14:01:43.727274 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 459/905] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:43 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:44.744409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-44edbab8-d72e-4761-a6d8-0d5a621b695f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:44.745073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-44edbab8-d72e-4761-a6d8-0d5a621b695f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:44.752311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44edbab8-d72e-4761-a6d8-0d5a621b695f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:44.752947 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44edbab8-d72e-4761-a6d8-0d5a621b695f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:44.753889 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44edbab8-d72e-4761-a6d8-0d5a621b695f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:44.754329 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-44edbab8-d72e-4761-a6d8-0d5a621b695f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:44.909829 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-44edbab8-d72e-4761-a6d8-0d5a621b695f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:44.919484 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-44edbab8-d72e-4761-a6d8-0d5a621b695f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1319 microversion: 2.1 time: 0.178607 May 19 14:01:44.920086 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 447/906] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:44 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:45.640529 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-4feba274-c708-4d4a-8b7e-a0828fad0bad req-022fff70-8f3b-44fe-9e53-f8244c27ec21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2a859a-1290-4808-9f0c-446b9d5dfee7", "tag": "2e95403e-403f-45b3-b656-464e76490bd6"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:01:45.650065 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-4feba274-c708-4d4a-8b7e-a0828fad0bad req-022fff70-8f3b-44fe-9e53-f8244c27ec21 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:45.650768 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-4feba274-c708-4d4a-8b7e-a0828fad0bad req-022fff70-8f3b-44fe-9e53-f8244c27ec21 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:45.663455 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-4feba274-c708-4d4a-8b7e-a0828fad0bad req-022fff70-8f3b-44fe-9e53-f8244c27ec21 service nova] Creating event network-changed:2e95403e-403f-45b3-b656-464e76490bd6 for instance 9a2a859a-1290-4808-9f0c-446b9d5dfee7 on hv-cinder-78481 May 19 14:01:45.669516 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-4feba274-c708-4d4a-8b7e-a0828fad0bad req-022fff70-8f3b-44fe-9e53-f8244c27ec21 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034389 May 19 14:01:45.670124 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 460/907] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:01:45.937793 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-48f7d216-d4e2-4dbe-b19a-5df65f4d08f3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:45.938254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-48f7d216-d4e2-4dbe-b19a-5df65f4d08f3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:45.944998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-48f7d216-d4e2-4dbe-b19a-5df65f4d08f3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:45.945851 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-48f7d216-d4e2-4dbe-b19a-5df65f4d08f3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:45.946961 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-48f7d216-d4e2-4dbe-b19a-5df65f4d08f3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:45.947573 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-48f7d216-d4e2-4dbe-b19a-5df65f4d08f3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:46.096338 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-48f7d216-d4e2-4dbe-b19a-5df65f4d08f3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:46.104252 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-48f7d216-d4e2-4dbe-b19a-5df65f4d08f3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1319 microversion: 2.1 time: 0.171748 May 19 14:01:46.104913 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 448/908] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:45 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:47.122599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2d48f3c6-4c74-4ad0-8ccf-f62b09ed57c8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:47.123577 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2d48f3c6-4c74-4ad0-8ccf-f62b09ed57c8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:47.129847 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2d48f3c6-4c74-4ad0-8ccf-f62b09ed57c8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:47.130299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2d48f3c6-4c74-4ad0-8ccf-f62b09ed57c8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:47.131115 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2d48f3c6-4c74-4ad0-8ccf-f62b09ed57c8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:47.131811 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2d48f3c6-4c74-4ad0-8ccf-f62b09ed57c8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:47.296720 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-2d48f3c6-4c74-4ad0-8ccf-f62b09ed57c8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:47.305406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2d48f3c6-4c74-4ad0-8ccf-f62b09ed57c8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1319 microversion: 2.1 time: 0.188134 May 19 14:01:47.305992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 461/909] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:47 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:48.323416 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7dc49246-1b0b-4872-b0b3-ad9af70dbe7d tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:48.324551 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7dc49246-1b0b-4872-b0b3-ad9af70dbe7d tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:48.331192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7dc49246-1b0b-4872-b0b3-ad9af70dbe7d tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:48.331709 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7dc49246-1b0b-4872-b0b3-ad9af70dbe7d tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:48.332419 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7dc49246-1b0b-4872-b0b3-ad9af70dbe7d tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:48.332883 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7dc49246-1b0b-4872-b0b3-ad9af70dbe7d tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:48.480185 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7dc49246-1b0b-4872-b0b3-ad9af70dbe7d tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:48.488776 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7dc49246-1b0b-4872-b0b3-ad9af70dbe7d tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1319 microversion: 2.1 time: 0.169277 May 19 14:01:48.489508 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 449/910] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:48 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:49.505680 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ff949c56-f502-49e7-8dd7-cfb045755147 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:49.506294 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ff949c56-f502-49e7-8dd7-cfb045755147 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:49.513621 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ff949c56-f502-49e7-8dd7-cfb045755147 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:49.514064 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ff949c56-f502-49e7-8dd7-cfb045755147 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:49.514826 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ff949c56-f502-49e7-8dd7-cfb045755147 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:49.515580 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ff949c56-f502-49e7-8dd7-cfb045755147 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:49.656896 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ff949c56-f502-49e7-8dd7-cfb045755147 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:49.664684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ff949c56-f502-49e7-8dd7-cfb045755147 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1319 microversion: 2.1 time: 0.162779 May 19 14:01:49.665341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 462/911] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:49 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:50.681741 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ed9a8cb5-f4ee-4d4a-8667-1c9312650d63 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:50.682351 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ed9a8cb5-f4ee-4d4a-8667-1c9312650d63 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:50.689623 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ed9a8cb5-f4ee-4d4a-8667-1c9312650d63 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:50.690073 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ed9a8cb5-f4ee-4d4a-8667-1c9312650d63 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:50.690852 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ed9a8cb5-f4ee-4d4a-8667-1c9312650d63 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:50.691298 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ed9a8cb5-f4ee-4d4a-8667-1c9312650d63 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:50.818248 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ed9a8cb5-f4ee-4d4a-8667-1c9312650d63 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:50.826345 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ed9a8cb5-f4ee-4d4a-8667-1c9312650d63 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1319 microversion: 2.1 time: 0.148664 May 19 14:01:50.826933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 450/912] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:50 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:51.219575 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-ea2fe539-8761-4181-ad2f-1a242674a12e req-cabc9eae-8c85-4dc7-bbd1-f93e9b12add2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2a859a-1290-4808-9f0c-446b9d5dfee7", "name": "network-vif-plugged", "status": "completed", "tag": "2e95403e-403f-45b3-b656-464e76490bd6"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:01:51.228747 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-ea2fe539-8761-4181-ad2f-1a242674a12e req-cabc9eae-8c85-4dc7-bbd1-f93e9b12add2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:51.229253 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-ea2fe539-8761-4181-ad2f-1a242674a12e req-cabc9eae-8c85-4dc7-bbd1-f93e9b12add2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:51.247174 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-ea2fe539-8761-4181-ad2f-1a242674a12e req-cabc9eae-8c85-4dc7-bbd1-f93e9b12add2 service nova] Creating event network-vif-plugged:2e95403e-403f-45b3-b656-464e76490bd6 for instance 9a2a859a-1290-4808-9f0c-446b9d5dfee7 on hv-cinder-78481 May 19 14:01:51.254196 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-ea2fe539-8761-4181-ad2f-1a242674a12e req-cabc9eae-8c85-4dc7-bbd1-f93e9b12add2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038295 May 19 14:01:51.257010 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 463/913] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:01:51.843096 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a782b8b2-4d14-4b56-995f-06231950d09f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:51.843621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a782b8b2-4d14-4b56-995f-06231950d09f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:51.850265 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a782b8b2-4d14-4b56-995f-06231950d09f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:51.850713 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a782b8b2-4d14-4b56-995f-06231950d09f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:51.851508 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a782b8b2-4d14-4b56-995f-06231950d09f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:51.851941 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a782b8b2-4d14-4b56-995f-06231950d09f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:51.986517 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a782b8b2-4d14-4b56-995f-06231950d09f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:51.994038 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a782b8b2-4d14-4b56-995f-06231950d09f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1319 microversion: 2.1 time: 0.155527 May 19 14:01:51.997238 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 451/914] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:51 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:53.008746 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:53.009772 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=6 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:53.014152 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-60390f07-969d-4b04-9dc1-38bdc004ce39 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:53.014887 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-60390f07-969d-4b04-9dc1-38bdc004ce39 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:53.022019 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-60390f07-969d-4b04-9dc1-38bdc004ce39 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:53.022472 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-60390f07-969d-4b04-9dc1-38bdc004ce39 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:53.023465 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-60390f07-969d-4b04-9dc1-38bdc004ce39 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:53.023708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-60390f07-969d-4b04-9dc1-38bdc004ce39 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:53.169699 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-60390f07-969d-4b04-9dc1-38bdc004ce39 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:53.177109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-60390f07-969d-4b04-9dc1-38bdc004ce39 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1508 microversion: 2.1 time: 0.169731 May 19 14:01:53.177676 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 464/915] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:53 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:57.312378 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-32a33aeb-1b86-4490-9711-2a540cd30747 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:57.312897 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-32a33aeb-1b86-4490-9711-2a540cd30747 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:57.314942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:57.320395 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-32a33aeb-1b86-4490-9711-2a540cd30747 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:57.320840 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-32a33aeb-1b86-4490-9711-2a540cd30747 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:57.321599 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-32a33aeb-1b86-4490-9711-2a540cd30747 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:57.322035 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-32a33aeb-1b86-4490-9711-2a540cd30747 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:57.413101 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-32a33aeb-1b86-4490-9711-2a540cd30747 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lazy-loading 'services' on Instance uuid 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:01:57.492201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-32a33aeb-1b86-4490-9711-2a540cd30747 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "DELETE /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/os-volume_attachments/e38adc76-7c72-4a69-9f4d-714a05f01fdf" status: 202 len: 0 microversion: 2.1 time: 0.183738 May 19 14:01:57.492821 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 452/916] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 14:01:57 2022] DELETE /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/os-volume_attachments/e38adc76-7c72-4a69-9f4d-714a05f01fdf => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:01:58.619418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a1dc2bf5-4ed0-4d8c-8c38-cb4dbc5dffe8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:01:58.626666 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a1dc2bf5-4ed0-4d8c-8c38-cb4dbc5dffe8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:58.627160 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a1dc2bf5-4ed0-4d8c-8c38-cb4dbc5dffe8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:58.648982 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a1dc2bf5-4ed0-4d8c-8c38-cb4dbc5dffe8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Going to try to stop instance {{(pid=123751) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 14:01:58.694262 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a1dc2bf5-4ed0-4d8c-8c38-cb4dbc5dffe8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/action" status: 202 len: 0 microversion: 2.1 time: 0.078414 May 19 14:01:58.695195 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 465/917] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 14:01:58 2022] POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:01:58.704808 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-11445a61-667c-4499-9448-800e019c5153 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:58.705515 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-11445a61-667c-4499-9448-800e019c5153 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:58.711872 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11445a61-667c-4499-9448-800e019c5153 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:58.712326 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11445a61-667c-4499-9448-800e019c5153 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:58.713101 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11445a61-667c-4499-9448-800e019c5153 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:58.713543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-11445a61-667c-4499-9448-800e019c5153 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:58.854957 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-11445a61-667c-4499-9448-800e019c5153 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:01:58.860341 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-11445a61-667c-4499-9448-800e019c5153 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.160379 May 19 14:01:58.861189 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 453/918] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:58 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:01:59.878408 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0b155079-f211-4156-a9c6-3872edfc7047 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:01:59.879155 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0b155079-f211-4156-a9c6-3872edfc7047 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:01:59.881074 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:01:59.887631 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0b155079-f211-4156-a9c6-3872edfc7047 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:59.888077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0b155079-f211-4156-a9c6-3872edfc7047 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:59.888833 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0b155079-f211-4156-a9c6-3872edfc7047 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:01:59.889267 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0b155079-f211-4156-a9c6-3872edfc7047 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:01:59.893760 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:02:00.025445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-0b155079-f211-4156-a9c6-3872edfc7047 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:00.033496 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0b155079-f211-4156-a9c6-3872edfc7047 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.159902 May 19 14:02:00.034057 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 466/919] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:01:59 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:01.050362 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-761cd34d-a3a4-4dd3-bc1d-91790d832999 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:01.051044 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-761cd34d-a3a4-4dd3-bc1d-91790d832999 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:01.053511 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:02:01.059136 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-761cd34d-a3a4-4dd3-bc1d-91790d832999 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:01.059603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-761cd34d-a3a4-4dd3-bc1d-91790d832999 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:01.060380 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-761cd34d-a3a4-4dd3-bc1d-91790d832999 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:01.060851 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-761cd34d-a3a4-4dd3-bc1d-91790d832999 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:01.064559 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:02:01.194482 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-761cd34d-a3a4-4dd3-bc1d-91790d832999 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:01.202693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-761cd34d-a3a4-4dd3-bc1d-91790d832999 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.156107 May 19 14:02:01.203361 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 454/920] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:01 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:02.219736 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7e8dbee3-0939-4eaa-bfed-352d1a441a51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:02.220464 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7e8dbee3-0939-4eaa-bfed-352d1a441a51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:02.227623 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e8dbee3-0939-4eaa-bfed-352d1a441a51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:02.228151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e8dbee3-0939-4eaa-bfed-352d1a441a51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:02.229049 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e8dbee3-0939-4eaa-bfed-352d1a441a51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:02.229639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7e8dbee3-0939-4eaa-bfed-352d1a441a51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:02.370356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7e8dbee3-0939-4eaa-bfed-352d1a441a51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:02.378053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7e8dbee3-0939-4eaa-bfed-352d1a441a51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.162613 May 19 14:02:02.378631 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 467/921] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:02 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:03.396884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-def0a995-2f9a-4cbd-b248-bd900ff9ee29 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:03.397497 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-def0a995-2f9a-4cbd-b248-bd900ff9ee29 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:03.405438 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-def0a995-2f9a-4cbd-b248-bd900ff9ee29 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:03.405897 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-def0a995-2f9a-4cbd-b248-bd900ff9ee29 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:03.406659 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-def0a995-2f9a-4cbd-b248-bd900ff9ee29 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:03.407127 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-def0a995-2f9a-4cbd-b248-bd900ff9ee29 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:03.540296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-def0a995-2f9a-4cbd-b248-bd900ff9ee29 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:03.548996 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-def0a995-2f9a-4cbd-b248-bd900ff9ee29 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.156011 May 19 14:02:03.549594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 455/922] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:03 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:04.565576 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c70ff0c6-1c41-4e08-8154-754a0b2ac26f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:04.566191 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c70ff0c6-1c41-4e08-8154-754a0b2ac26f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:04.573070 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c70ff0c6-1c41-4e08-8154-754a0b2ac26f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:04.573527 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c70ff0c6-1c41-4e08-8154-754a0b2ac26f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:04.575084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c70ff0c6-1c41-4e08-8154-754a0b2ac26f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:04.575526 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c70ff0c6-1c41-4e08-8154-754a0b2ac26f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:04.713541 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c70ff0c6-1c41-4e08-8154-754a0b2ac26f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:04.721120 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c70ff0c6-1c41-4e08-8154-754a0b2ac26f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.159479 May 19 14:02:04.721687 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 468/923] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:04 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:05.738346 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cf718872-9794-4549-9ae5-48f05dcb63bb tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:05.739144 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cf718872-9794-4549-9ae5-48f05dcb63bb tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:05.747914 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf718872-9794-4549-9ae5-48f05dcb63bb tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:05.748360 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf718872-9794-4549-9ae5-48f05dcb63bb tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:05.749217 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf718872-9794-4549-9ae5-48f05dcb63bb tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:05.749967 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf718872-9794-4549-9ae5-48f05dcb63bb tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:05.898898 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cf718872-9794-4549-9ae5-48f05dcb63bb tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:05.907027 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cf718872-9794-4549-9ae5-48f05dcb63bb tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.173452 May 19 14:02:05.908240 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 456/924] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:05 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:02:06.924300 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7d174aea-0879-49d3-8639-4e8c0cec93fa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:06.924917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7d174aea-0879-49d3-8639-4e8c0cec93fa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:06.931395 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7d174aea-0879-49d3-8639-4e8c0cec93fa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:06.931834 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7d174aea-0879-49d3-8639-4e8c0cec93fa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:06.932599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7d174aea-0879-49d3-8639-4e8c0cec93fa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:06.933036 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7d174aea-0879-49d3-8639-4e8c0cec93fa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:07.065354 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7d174aea-0879-49d3-8639-4e8c0cec93fa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:07.074523 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7d174aea-0879-49d3-8639-4e8c0cec93fa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.154027 May 19 14:02:07.075627 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 469/925] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:06 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:08.091291 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9b165b8e-2cb3-475c-8ffe-c49ff9a40335 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:08.091961 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9b165b8e-2cb3-475c-8ffe-c49ff9a40335 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:08.101120 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b165b8e-2cb3-475c-8ffe-c49ff9a40335 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:08.101571 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b165b8e-2cb3-475c-8ffe-c49ff9a40335 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:08.102339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b165b8e-2cb3-475c-8ffe-c49ff9a40335 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:08.102769 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b165b8e-2cb3-475c-8ffe-c49ff9a40335 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:08.231954 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9b165b8e-2cb3-475c-8ffe-c49ff9a40335 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:08.239503 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9b165b8e-2cb3-475c-8ffe-c49ff9a40335 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.152243 May 19 14:02:08.240100 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 457/926] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:08 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:09.258066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e2e92aa5-b51c-40df-b615-4636d63133b0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:09.258678 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e2e92aa5-b51c-40df-b615-4636d63133b0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:09.265864 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e2e92aa5-b51c-40df-b615-4636d63133b0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:09.266313 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e2e92aa5-b51c-40df-b615-4636d63133b0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:09.267107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e2e92aa5-b51c-40df-b615-4636d63133b0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:09.267545 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e2e92aa5-b51c-40df-b615-4636d63133b0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:09.397691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e2e92aa5-b51c-40df-b615-4636d63133b0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:09.406380 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e2e92aa5-b51c-40df-b615-4636d63133b0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.152471 May 19 14:02:09.406978 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 470/927] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:09 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:10.174667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:02:10.174903 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Thu May 19 14:02:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:02:10.423453 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-10011799-850d-4a33-8ded-b9e9ce8d7e51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:10.424957 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-10011799-850d-4a33-8ded-b9e9ce8d7e51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:10.431226 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10011799-850d-4a33-8ded-b9e9ce8d7e51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:10.431705 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10011799-850d-4a33-8ded-b9e9ce8d7e51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:10.432488 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10011799-850d-4a33-8ded-b9e9ce8d7e51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:10.432920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10011799-850d-4a33-8ded-b9e9ce8d7e51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:10.562493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-10011799-850d-4a33-8ded-b9e9ce8d7e51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:10.570077 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-10011799-850d-4a33-8ded-b9e9ce8d7e51 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.150670 May 19 14:02:10.570640 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 458/928] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:10 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:11.587222 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f293becd-9fd3-4e7d-a621-e79bac002c2e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:11.587833 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f293becd-9fd3-4e7d-a621-e79bac002c2e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:11.595041 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f293becd-9fd3-4e7d-a621-e79bac002c2e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:11.595491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f293becd-9fd3-4e7d-a621-e79bac002c2e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:11.596251 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f293becd-9fd3-4e7d-a621-e79bac002c2e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:11.596684 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f293becd-9fd3-4e7d-a621-e79bac002c2e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:11.730917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f293becd-9fd3-4e7d-a621-e79bac002c2e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:11.738594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f293becd-9fd3-4e7d-a621-e79bac002c2e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1677 microversion: 2.1 time: 0.155236 May 19 14:02:11.739193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 471/929] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:11 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:12.756044 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4fef1d82-b34f-48f3-9543-d1e33364a95a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:12.756920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4fef1d82-b34f-48f3-9543-d1e33364a95a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:12.763608 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4fef1d82-b34f-48f3-9543-d1e33364a95a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:12.764062 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4fef1d82-b34f-48f3-9543-d1e33364a95a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:12.764830 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4fef1d82-b34f-48f3-9543-d1e33364a95a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:12.765271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4fef1d82-b34f-48f3-9543-d1e33364a95a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:12.908249 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4fef1d82-b34f-48f3-9543-d1e33364a95a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:12.916524 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4fef1d82-b34f-48f3-9543-d1e33364a95a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1654 microversion: 2.1 time: 0.164171 May 19 14:02:12.917132 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 459/930] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:12 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1654 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:12.937537 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fd9c7d9f-e16f-4183-a93f-5cb429ed2dfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:02:12.943681 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fd9c7d9f-e16f-4183-a93f-5cb429ed2dfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:12.944128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fd9c7d9f-e16f-4183-a93f-5cb429ed2dfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:12.968554 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-fd9c7d9f-e16f-4183-a93f-5cb429ed2dfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Going to try to start instance {{(pid=123751) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 14:02:13.010156 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-fd9c7d9f-e16f-4183-a93f-5cb429ed2dfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/action" status: 202 len: 0 microversion: 2.1 time: 0.076861 May 19 14:02:13.010671 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 472/931] 10.222.0.52 () {60 vars in 1277 bytes} [Thu May 19 14:02:12 2022] POST /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:02:13.019694 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f16b636a-53f1-41da-a243-12b3fce024d2 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:13.020306 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f16b636a-53f1-41da-a243-12b3fce024d2 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:13.026928 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f16b636a-53f1-41da-a243-12b3fce024d2 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:13.027533 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f16b636a-53f1-41da-a243-12b3fce024d2 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:13.028944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f16b636a-53f1-41da-a243-12b3fce024d2 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:13.029383 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f16b636a-53f1-41da-a243-12b3fce024d2 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:13.166745 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f16b636a-53f1-41da-a243-12b3fce024d2 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:13.174737 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f16b636a-53f1-41da-a243-12b3fce024d2 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1663 microversion: 2.1 time: 0.158813 May 19 14:02:13.175549 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 460/932] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:13 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:13.587418 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e5890c71-f5ed-485c-8116-823e4bdd7600 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b56f7e2d-d150-462b-90d3-d30b3a17675c", "device": "/dev/sdb"}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:02:13.589491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e5890c71-f5ed-485c-8116-823e4bdd7600 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:13.596484 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5890c71-f5ed-485c-8116-823e4bdd7600 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:13.596939 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5890c71-f5ed-485c-8116-823e4bdd7600 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:13.597709 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5890c71-f5ed-485c-8116-823e4bdd7600 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:13.598149 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e5890c71-f5ed-485c-8116-823e4bdd7600 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:14.192389 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-edd2c816-9990-4ad3-994d-8736c70490c7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:14.193047 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-edd2c816-9990-4ad3-994d-8736c70490c7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:14.199607 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edd2c816-9990-4ad3-994d-8736c70490c7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:14.201377 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edd2c816-9990-4ad3-994d-8736c70490c7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:14.201605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edd2c816-9990-4ad3-994d-8736c70490c7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:14.202051 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edd2c816-9990-4ad3-994d-8736c70490c7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:14.330657 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-edd2c816-9990-4ad3-994d-8736c70490c7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:14.338197 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-edd2c816-9990-4ad3-994d-8736c70490c7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1663 microversion: 2.1 time: 0.149827 May 19 14:02:14.338761 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 461/933] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:14 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1663 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:15.355565 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d4a37893-09c4-422d-8701-859096373617 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:15.356685 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d4a37893-09c4-422d-8701-859096373617 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:15.363311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4a37893-09c4-422d-8701-859096373617 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:15.363758 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4a37893-09c4-422d-8701-859096373617 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:15.364516 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4a37893-09c4-422d-8701-859096373617 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:15.364953 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d4a37893-09c4-422d-8701-859096373617 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:15.497125 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d4a37893-09c4-422d-8701-859096373617 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:15.504621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d4a37893-09c4-422d-8701-859096373617 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1663 microversion: 2.1 time: 0.153063 May 19 14:02:15.505213 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 462/934] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:15 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1663 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:16.015862 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e5890c71-f5ed-485c-8116-823e4bdd7600 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "POST /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.432585 May 19 14:02:16.016737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 473/935] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 14:02:13 2022] POST /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7/os-volume_attachments => generated 194 bytes in 2434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:02:16.521845 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2d80b5b3-a816-4357-ad7d-711ace7cd7f7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:16.522354 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2d80b5b3-a816-4357-ad7d-711ace7cd7f7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:16.529079 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2d80b5b3-a816-4357-ad7d-711ace7cd7f7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:16.529530 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2d80b5b3-a816-4357-ad7d-711ace7cd7f7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:16.530299 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2d80b5b3-a816-4357-ad7d-711ace7cd7f7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:16.530738 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2d80b5b3-a816-4357-ad7d-711ace7cd7f7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:16.668312 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2d80b5b3-a816-4357-ad7d-711ace7cd7f7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:16.676228 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2d80b5b3-a816-4357-ad7d-711ace7cd7f7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1663 microversion: 2.1 time: 0.158340 May 19 14:02:16.676858 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 463/936] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:16 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:17.694461 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-40c750db-41a2-4032-8eed-9f66e83a3eba tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:17.695118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-40c750db-41a2-4032-8eed-9f66e83a3eba tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:17.702762 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40c750db-41a2-4032-8eed-9f66e83a3eba tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:17.703245 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40c750db-41a2-4032-8eed-9f66e83a3eba tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:17.704000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40c750db-41a2-4032-8eed-9f66e83a3eba tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:17.704435 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40c750db-41a2-4032-8eed-9f66e83a3eba tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:17.836192 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-40c750db-41a2-4032-8eed-9f66e83a3eba tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:17.844060 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-40c750db-41a2-4032-8eed-9f66e83a3eba tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1667 microversion: 2.1 time: 0.153883 May 19 14:02:17.844631 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 474/937] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:17 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:31.573046 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-86a34d71-f167-4fd2-80ec-c1e324b00827 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:31.575588 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-86a34d71-f167-4fd2-80ec-c1e324b00827 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:31.577002 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-e1872ca8-0248-439c-a99d-7ae013638d91 req-2adc2170-c531-4569-9d0a-14e99b67a27c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ccab6e9-3133-4db9-a8d9-27c83353c00a", "tag": "80eac5d4-3a31-4ac5-b15f-b7109c704ba1"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:02:31.580048 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=19 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:02:31.581695 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=59 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:02:31.585656 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-86a34d71-f167-4fd2-80ec-c1e324b00827 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:31.586404 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-86a34d71-f167-4fd2-80ec-c1e324b00827 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:31.587533 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-86a34d71-f167-4fd2-80ec-c1e324b00827 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:31.588224 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-86a34d71-f167-4fd2-80ec-c1e324b00827 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:31.589182 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=17 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:02:31.591230 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:02:31.595357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-e1872ca8-0248-439c-a99d-7ae013638d91 req-2adc2170-c531-4569-9d0a-14e99b67a27c service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:31.596781 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-e1872ca8-0248-439c-a99d-7ae013638d91 req-2adc2170-c531-4569-9d0a-14e99b67a27c service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:31.617314 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-86a34d71-f167-4fd2-80ec-c1e324b00827 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:02:31.619433 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-e1872ca8-0248-439c-a99d-7ae013638d91 req-2adc2170-c531-4569-9d0a-14e99b67a27c service nova] Creating event network-changed:80eac5d4-3a31-4ac5-b15f-b7109c704ba1 for instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a on hv-cinder-78481 May 19 14:02:31.625732 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-e1872ca8-0248-439c-a99d-7ae013638d91 req-2adc2170-c531-4569-9d0a-14e99b67a27c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053497 May 19 14:02:31.627099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 475/938] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:02:31.744230 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-86a34d71-f167-4fd2-80ec-c1e324b00827 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 204 len: 0 microversion: 2.1 time: 0.174852 May 19 14:02:31.745360 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 464/939] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:02:31 2022] DELETE /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:02:31.758653 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5fe5827e-2d82-45ac-b071-212719a02243 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:31.760687 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5fe5827e-2d82-45ac-b071-212719a02243 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:31.770821 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5fe5827e-2d82-45ac-b071-212719a02243 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:31.772394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5fe5827e-2d82-45ac-b071-212719a02243 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:31.773460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5fe5827e-2d82-45ac-b071-212719a02243 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:31.774168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5fe5827e-2d82-45ac-b071-212719a02243 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:31.931103 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5fe5827e-2d82-45ac-b071-212719a02243 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:31.939482 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5fe5827e-2d82-45ac-b071-212719a02243 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.188350 May 19 14:02:31.940550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 476/940] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:31 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:32.958785 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3b9a3427-07ae-40df-aa91-04d9ea1717e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:32.959460 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3b9a3427-07ae-40df-aa91-04d9ea1717e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:32.966589 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b9a3427-07ae-40df-aa91-04d9ea1717e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:32.967064 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b9a3427-07ae-40df-aa91-04d9ea1717e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:32.967831 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b9a3427-07ae-40df-aa91-04d9ea1717e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:32.968268 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b9a3427-07ae-40df-aa91-04d9ea1717e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:33.103313 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3b9a3427-07ae-40df-aa91-04d9ea1717e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:33.111819 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3b9a3427-07ae-40df-aa91-04d9ea1717e8 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.157919 May 19 14:02:33.120089 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 465/941] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:32 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:34.128939 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-283f4bbf-5795-4184-9b7a-843784a4fe66 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:34.129553 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-283f4bbf-5795-4184-9b7a-843784a4fe66 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:34.136312 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-283f4bbf-5795-4184-9b7a-843784a4fe66 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:34.137018 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-283f4bbf-5795-4184-9b7a-843784a4fe66 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:34.137950 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-283f4bbf-5795-4184-9b7a-843784a4fe66 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:34.138381 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-283f4bbf-5795-4184-9b7a-843784a4fe66 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:34.268505 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-283f4bbf-5795-4184-9b7a-843784a4fe66 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:34.275946 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-283f4bbf-5795-4184-9b7a-843784a4fe66 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.150878 May 19 14:02:34.276506 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 477/942] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:34 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:35.294075 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3736d891-d8d3-4b60-a67b-93bc217b4dfa tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:35.294678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3736d891-d8d3-4b60-a67b-93bc217b4dfa tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:35.301112 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3736d891-d8d3-4b60-a67b-93bc217b4dfa tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:35.301557 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3736d891-d8d3-4b60-a67b-93bc217b4dfa tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:35.302313 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3736d891-d8d3-4b60-a67b-93bc217b4dfa tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:35.302742 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3736d891-d8d3-4b60-a67b-93bc217b4dfa tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:35.449051 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3736d891-d8d3-4b60-a67b-93bc217b4dfa tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:35.457021 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3736d891-d8d3-4b60-a67b-93bc217b4dfa tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1569 microversion: 2.1 time: 0.166926 May 19 14:02:35.457581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 466/943] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:35 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:36.357624 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-56ccf3e1-5a09-4c32-a80d-6d66ae0d542b req-67d2c7a4-22c5-4298-8faa-a587acc9f10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ccab6e9-3133-4db9-a8d9-27c83353c00a", "name": "network-vif-deleted", "tag": "80eac5d4-3a31-4ac5-b15f-b7109c704ba1"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:02:36.369740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-56ccf3e1-5a09-4c32-a80d-6d66ae0d542b req-67d2c7a4-22c5-4298-8faa-a587acc9f10e service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:36.370187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-56ccf3e1-5a09-4c32-a80d-6d66ae0d542b req-67d2c7a4-22c5-4298-8faa-a587acc9f10e service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:36.382600 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-56ccf3e1-5a09-4c32-a80d-6d66ae0d542b req-67d2c7a4-22c5-4298-8faa-a587acc9f10e service nova] Creating event network-vif-deleted:80eac5d4-3a31-4ac5-b15f-b7109c704ba1 for instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a on hv-cinder-78481 May 19 14:02:36.389515 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-56ccf3e1-5a09-4c32-a80d-6d66ae0d542b req-67d2c7a4-22c5-4298-8faa-a587acc9f10e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036559 May 19 14:02:36.390517 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 478/944] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:02:36.474343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a5e00a08-e437-4ac4-83b7-c56eeb8abe28 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:36.474985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a5e00a08-e437-4ac4-83b7-c56eeb8abe28 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:36.482082 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5e00a08-e437-4ac4-83b7-c56eeb8abe28 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:36.482524 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5e00a08-e437-4ac4-83b7-c56eeb8abe28 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:36.483314 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5e00a08-e437-4ac4-83b7-c56eeb8abe28 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:36.483752 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5e00a08-e437-4ac4-83b7-c56eeb8abe28 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:36.555048 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a5e00a08-e437-4ac4-83b7-c56eeb8abe28 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5fabcc754684ded96c800be75777553', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0197b4cff99649ef9da1e77b1461dd76', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:36.561867 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a5e00a08-e437-4ac4-83b7-c56eeb8abe28 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 200 len: 1218 microversion: 2.1 time: 0.091817 May 19 14:02:36.562433 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 467/945] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:36 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 1218 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:37.578026 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:37.578737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] [instance: 7ccab6e9-3133-4db9-a8d9-27c83353c00a] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:37.585625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:37.586085 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:37.586882 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:37.587414 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:37.600951 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] HTTP exception thrown: Instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a could not be found. May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Request method failure captured: May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a HTTP/1.1 May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihky1i5Sg__nkWlB55TtxAt8__ZXd06wP7gmNroOf6mTvTmSsShbMNMCj1WoOFlhzF6SeV5VyIa0tsHPQI1TzCshhya1-ix5YfpCEyih96jWFXwIyh54DII1tJMBcfZrTltwQ5kkyNhP2VY9qgiW3n0WBMh-4SaFMgs4CC5gFWFEuan8 May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 0197b4cff99649ef9da1e77b1461dd76 May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-TestShelveInstance-1547591820 May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:02:37.602596 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_0197b4cff99649ef9da1e77b1461dd76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0197b4cff99649ef9da1e77b1461dd76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/0197b4cff99649ef9da1e77b1461dd76"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/0197b4cff99649ef9da1e77b1461dd76"}]}] May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-TestShelveInstance-1547591820 May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 0197b4cff99649ef9da1e77b1461dd76 May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-TestShelveInstance-1547591820 May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-TestShelveInstance-1547591820-project May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: d5fabcc754684ded96c800be75777553 May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-TestShelveInstance-1547591820-project May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a could not be found. May 19 14:02:37.604269 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '7ccab6e9-3133-4db9-a8d9-27c83353c00a'} May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a could not be found. May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:02:37.605186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a could not be found. May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a could not be found. May 19 14:02:37.606711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:37.608702 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Returning 404 to user: Instance 7ccab6e9-3133-4db9-a8d9-27c83353c00a could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:02:37.608702 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f9f5db28-13c6-482a-812a-41952eb0d338 tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a" status: 404 len: 111 microversion: 2.1 time: 0.030349 May 19 14:02:37.608702 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 479/946] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:37 2022] GET /compute/v2.1/servers/7ccab6e9-3133-4db9-a8d9-27c83353c00a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:02:37.784995 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b4dfbdaf-2398-4a6e-83b7-671f89b9f66a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] Calling method '.version_select at 0x7f5de1c27670>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:37.804101 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b4dfbdaf-2398-4a6e-83b7-671f89b9f66a tempest-TestShelveInstance-1547591820 tempest-TestShelveInstance-1547591820-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-788156017" status: 202 len: 0 microversion: 2.1 time: 0.023006 May 19 14:02:37.804874 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 468/947] 10.222.0.52 () {58 vars in 1250 bytes} [Thu May 19 14:02:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-788156017 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:02:39.894542 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bddbfc03-2296-4b2f-973a-b4ca9e046c6e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:39.895230 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bddbfc03-2296-4b2f-973a-b4ca9e046c6e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:39.902188 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bddbfc03-2296-4b2f-973a-b4ca9e046c6e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:39.902645 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bddbfc03-2296-4b2f-973a-b4ca9e046c6e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:39.903451 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bddbfc03-2296-4b2f-973a-b4ca9e046c6e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:39.904533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bddbfc03-2296-4b2f-973a-b4ca9e046c6e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:39.987518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-bddbfc03-2296-4b2f-973a-b4ca9e046c6e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lazy-loading 'services' on Instance uuid 9a2a859a-1290-4808-9f0c-446b9d5dfee7 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:02:40.064057 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bddbfc03-2296-4b2f-973a-b4ca9e046c6e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7/os-volume_attachments/b56f7e2d-d150-462b-90d3-d30b3a17675c" status: 202 len: 0 microversion: 2.1 time: 0.173303 May 19 14:02:40.064760 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 480/948] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 14:02:39 2022] DELETE /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7/os-volume_attachments/b56f7e2d-d150-462b-90d3-d30b3a17675c => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:02:43.307754 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ff97bca6-ae9b-4591-83e7-f0c11cdbe1b8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:43.308848 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ff97bca6-ae9b-4591-83e7-f0c11cdbe1b8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:43.318180 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff97bca6-ae9b-4591-83e7-f0c11cdbe1b8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:43.318992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff97bca6-ae9b-4591-83e7-f0c11cdbe1b8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:43.320126 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff97bca6-ae9b-4591-83e7-f0c11cdbe1b8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:43.320565 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff97bca6-ae9b-4591-83e7-f0c11cdbe1b8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:43.358070 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ff97bca6-ae9b-4591-83e7-f0c11cdbe1b8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:02:43.484478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ff97bca6-ae9b-4591-83e7-f0c11cdbe1b8 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 204 len: 0 microversion: 2.1 time: 0.185675 May 19 14:02:43.489378 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 469/949] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:02:43 2022] DELETE /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:02:43.511430 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a3ae251f-8ae1-47ed-aaf5-69f8a9614fb1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:43.515870 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a3ae251f-8ae1-47ed-aaf5-69f8a9614fb1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:43.530400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a3ae251f-8ae1-47ed-aaf5-69f8a9614fb1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:43.532425 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a3ae251f-8ae1-47ed-aaf5-69f8a9614fb1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:43.533400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a3ae251f-8ae1-47ed-aaf5-69f8a9614fb1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:43.534185 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a3ae251f-8ae1-47ed-aaf5-69f8a9614fb1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:43.810231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a3ae251f-8ae1-47ed-aaf5-69f8a9614fb1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:43.823716 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a3ae251f-8ae1-47ed-aaf5-69f8a9614fb1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1514 microversion: 2.1 time: 0.333284 May 19 14:02:43.829110 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 481/950] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:43 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1514 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:44.844313 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4a52c04f-0299-4904-a532-10aba5dd4848 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:44.844954 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4a52c04f-0299-4904-a532-10aba5dd4848 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:44.851543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4a52c04f-0299-4904-a532-10aba5dd4848 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:44.852024 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4a52c04f-0299-4904-a532-10aba5dd4848 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:44.852796 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4a52c04f-0299-4904-a532-10aba5dd4848 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:44.853232 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4a52c04f-0299-4904-a532-10aba5dd4848 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:44.994414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4a52c04f-0299-4904-a532-10aba5dd4848 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:45.003741 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4a52c04f-0299-4904-a532-10aba5dd4848 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1514 microversion: 2.1 time: 0.163388 May 19 14:02:45.005106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 470/951] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:44 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:45.849558 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-c5deb52b-2815-4586-8fc0-e4b9898665b2 req-bd947660-4c71-4ece-93a2-a8f5a6576148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2a859a-1290-4808-9f0c-446b9d5dfee7", "name": "network-vif-deleted", "tag": "2e95403e-403f-45b3-b656-464e76490bd6"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:02:45.862351 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-c5deb52b-2815-4586-8fc0-e4b9898665b2 req-bd947660-4c71-4ece-93a2-a8f5a6576148 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:45.863118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-c5deb52b-2815-4586-8fc0-e4b9898665b2 req-bd947660-4c71-4ece-93a2-a8f5a6576148 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:45.877363 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-c5deb52b-2815-4586-8fc0-e4b9898665b2 req-bd947660-4c71-4ece-93a2-a8f5a6576148 service nova] Creating event network-vif-deleted:2e95403e-403f-45b3-b656-464e76490bd6 for instance 9a2a859a-1290-4808-9f0c-446b9d5dfee7 on hv-cinder-78481 May 19 14:02:45.884059 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-c5deb52b-2815-4586-8fc0-e4b9898665b2 req-bd947660-4c71-4ece-93a2-a8f5a6576148 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038559 May 19 14:02:45.885315 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 482/952] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:02:46.021786 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:46.022577 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:46.029891 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:46.030347 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:46.031170 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:46.032033 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:46.067113 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:46.067631 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:46.068368 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lazy-loading 'fault' on Instance uuid 9a2a859a-1290-4808-9f0c-446b9d5dfee7 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:02:46.138404 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:46.146074 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d79db6c0-07a5-4909-b745-364e0091f48e tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 200 len: 1309 microversion: 2.1 time: 0.128261 May 19 14:02:46.146643 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 471/953] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:46 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:47.164846 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:47.165705 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 9a2a859a-1290-4808-9f0c-446b9d5dfee7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:47.175740 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:47.176331 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:47.177233 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:47.177763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:47.196555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] HTTP exception thrown: Instance 9a2a859a-1290-4808-9f0c-446b9d5dfee7 could not be found. May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Request method failure captured: May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 HTTP/1.1 May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihk3DDKFAhikKo23wF77rANHa_aLQXXNgzqfBVL-B3RpFKpGGifkP0Z8iFAjhVYug_gjH6wb8MjGlm-BeCgytl_loqQPQqZgBlfi1Iwf3EDAbgQ1PIfiuKMhXgw_p1Ca03_Eqi716QkRYHzaSH9cX4ucGOT4VZSB59lPZXviB7w23M_k May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: f68358e9d695445490f8209d832a1c13 May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1128149502 May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:02:47.198224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f68358e9d695445490f8209d832a1c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f68358e9d695445490f8209d832a1c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f68358e9d695445490f8209d832a1c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f68358e9d695445490f8209d832a1c13"}]}] May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesSnapshotTestJSON-1128149502 May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: f68358e9d695445490f8209d832a1c13 May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1128149502 May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesSnapshotTestJSON-1128149502-project May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 12d3af57f5e34f798336d353a111cefd May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesSnapshotTestJSON-1128149502-project May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 9a2a859a-1290-4808-9f0c-446b9d5dfee7 could not be found. May 19 14:02:47.200336 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '9a2a859a-1290-4808-9f0c-446b9d5dfee7'} May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2a859a-1290-4808-9f0c-446b9d5dfee7 could not be found. May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:02:47.202236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2a859a-1290-4808-9f0c-446b9d5dfee7 could not be found. May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2a859a-1290-4808-9f0c-446b9d5dfee7 could not be found. May 19 14:02:47.208400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:02:47.209782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Returning 404 to user: Instance 9a2a859a-1290-4808-9f0c-446b9d5dfee7 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:02:47.209782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a2bdbb82-9e3e-4a02-af54-fabed2e9e931 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7" status: 404 len: 111 microversion: 2.1 time: 0.040148 May 19 14:02:47.209782 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 483/954] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:47 2022] GET /compute/v2.1/servers/9a2a859a-1290-4808-9f0c-446b9d5dfee7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:02:56.064779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:02:56.142933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:02:56.217756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2c7ad0b5-c4f8-4daf-9715-60debc437975 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Action: 'create', calling method: .version_select at 0x7f5de1dfa160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-37618688", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxfn9POLtbUdUNAkL4+JD70UqKtuDcYjVOY/bo4KfXnYy6zeMVcMe7PlCQ5HR8zZYCnCwAlZgz18LJeFdMk5qza1kLuX7LYhR/KTduI0V4wz+MnOMfjV133UPQQZXGT2Q=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:02:56.234510 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-2c7ad0b5-c4f8-4daf-9715-60debc437975 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Getting quotas for project 6d87d3963b1b4fb29e09d8f72f64fb6e. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 14:02:56.240287 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-2c7ad0b5-c4f8-4daf-9715-60debc437975 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Getting quotas for user df54f67274d24463961e1f48dcb37447 and project 6d87d3963b1b4fb29e09d8f72f64fb6e. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 14:02:56.273052 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2c7ad0b5-c4f8-4daf-9715-60debc437975 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.233933 May 19 14:02:56.273655 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 472/955] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 14:02:56 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:02:56.303160 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-568639572", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "networks": [{"uuid": "8c8b2849-e551-4065-bc90-6e6a7b094720"}]}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:02:56.360720 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] validate_networks() for [('8c8b2849-e551-4065-bc90-6e6a7b094720', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 14:02:56.768942 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 14:02:56.769372 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 14:02:56.769850 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 14:02:56.770319 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 14:02:56.770735 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 14:02:56.781142 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:56.781594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:56.782403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:56.782845 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:56.801528 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Getting quotas for project f68358e9d695445490f8209d832a1c13. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 14:02:56.806179 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Getting quotas for user 12d3af57f5e34f798336d353a111cefd and project f68358e9d695445490f8209d832a1c13. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 14:02:56.817934 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 14:02:56.820268 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 14:02:56.871798 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-06948faa-6887-4970-89d8-1e0bb4ab9d2a tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572863 May 19 14:02:56.873254 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 484/956] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 14:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 14:02:56.886200 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5f809b4a-a331-4bc0-a942-4ddb100cb4a4 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:56.890271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5f809b4a-a331-4bc0-a942-4ddb100cb4a4 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:56.960682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5f809b4a-a331-4bc0-a942-4ddb100cb4a4 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:56.968513 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5f809b4a-a331-4bc0-a942-4ddb100cb4a4 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1218 microversion: 2.1 time: 0.087981 May 19 14:02:56.969378 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 473/957] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:56 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:57.955384 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2c0818ba-4661-4b12-a83f-de6da1d65e70 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:57.956639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2c0818ba-4661-4b12-a83f-de6da1d65e70 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:57.962772 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c0818ba-4661-4b12-a83f-de6da1d65e70 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:57.963263 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c0818ba-4661-4b12-a83f-de6da1d65e70 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:57.964043 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c0818ba-4661-4b12-a83f-de6da1d65e70 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:57.964485 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2c0818ba-4661-4b12-a83f-de6da1d65e70 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:57.986929 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fbb1ff80-a5a4-4502-bebd-302b2eee0d78 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:57.987525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fbb1ff80-a5a4-4502-bebd-302b2eee0d78 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:57.995804 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff80-a5a4-4502-bebd-302b2eee0d78 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:57.996277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff80-a5a4-4502-bebd-302b2eee0d78 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:57.997066 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff80-a5a4-4502-bebd-302b2eee0d78 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:57.998218 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2c0818ba-4661-4b12-a83f-de6da1d65e70 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046822 May 19 14:02:57.998408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbb1ff80-a5a4-4502-bebd-302b2eee0d78 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:57.999344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 485/958] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 14:02:57 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 14:02:58.061988 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5c32c97d-d3ad-435c-b092-d86a2093840b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:58.062567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5c32c97d-d3ad-435c-b092-d86a2093840b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:58.068986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5c32c97d-d3ad-435c-b092-d86a2093840b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:58.069653 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5c32c97d-d3ad-435c-b092-d86a2093840b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:58.070587 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5c32c97d-d3ad-435c-b092-d86a2093840b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:58.071208 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5c32c97d-d3ad-435c-b092-d86a2093840b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:58.092320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fbb1ff80-a5a4-4502-bebd-302b2eee0d78 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:58.099023 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5c32c97d-d3ad-435c-b092-d86a2093840b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Going to try to terminate instance {{(pid=123751) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:02:58.103762 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fbb1ff80-a5a4-4502-bebd-302b2eee0d78 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1270 microversion: 2.1 time: 0.120844 May 19 14:02:58.104615 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 474/959] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:57 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1270 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:02:58.205755 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5c32c97d-d3ad-435c-b092-d86a2093840b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "DELETE /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 204 len: 0 microversion: 2.1 time: 0.147853 May 19 14:02:58.209998 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 486/960] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:02:58 2022] DELETE /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:02:58.215064 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c826ffdf-57f4-443a-923e-a7d4cbc2e49f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:58.216856 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c826ffdf-57f4-443a-923e-a7d4cbc2e49f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:58.223336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c826ffdf-57f4-443a-923e-a7d4cbc2e49f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:58.224045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c826ffdf-57f4-443a-923e-a7d4cbc2e49f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:58.225004 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c826ffdf-57f4-443a-923e-a7d4cbc2e49f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:58.225649 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c826ffdf-57f4-443a-923e-a7d4cbc2e49f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:58.428968 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c826ffdf-57f4-443a-923e-a7d4cbc2e49f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:58.438306 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c826ffdf-57f4-443a-923e-a7d4cbc2e49f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1673 microversion: 2.1 time: 0.227104 May 19 14:02:58.438932 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 475/961] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:58 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1673 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:02:59.123697 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8bc3f41d-b990-4222-9878-85aa62deb87c tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:59.125078 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8bc3f41d-b990-4222-9878-85aa62deb87c tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:59.132275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8bc3f41d-b990-4222-9878-85aa62deb87c tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:59.132722 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8bc3f41d-b990-4222-9878-85aa62deb87c tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:59.133497 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8bc3f41d-b990-4222-9878-85aa62deb87c tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:59.133932 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8bc3f41d-b990-4222-9878-85aa62deb87c tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:59.201468 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8bc3f41d-b990-4222-9878-85aa62deb87c tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:59.209523 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8bc3f41d-b990-4222-9878-85aa62deb87c tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1288 microversion: 2.1 time: 0.090502 May 19 14:02:59.210101 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 487/962] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:59 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:02:59.455853 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3e50d889-d8fe-4896-bd34-7c419786b56d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:02:59.456508 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3e50d889-d8fe-4896-bd34-7c419786b56d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:02:59.463035 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e50d889-d8fe-4896-bd34-7c419786b56d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:59.463493 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e50d889-d8fe-4896-bd34-7c419786b56d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:59.464289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e50d889-d8fe-4896-bd34-7c419786b56d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:02:59.464750 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e50d889-d8fe-4896-bd34-7c419786b56d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:02:59.608667 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3e50d889-d8fe-4896-bd34-7c419786b56d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:02:59.616831 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3e50d889-d8fe-4896-bd34-7c419786b56d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1673 microversion: 2.1 time: 0.165098 May 19 14:02:59.617411 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 476/963] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:02:59 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:00.226920 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d1a92483-5f4d-4bae-a8a7-042f8853f9cc tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:00.230212 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d1a92483-5f4d-4bae-a8a7-042f8853f9cc tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:00.240209 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d1a92483-5f4d-4bae-a8a7-042f8853f9cc tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:00.241029 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d1a92483-5f4d-4bae-a8a7-042f8853f9cc tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:00.241834 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d1a92483-5f4d-4bae-a8a7-042f8853f9cc tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:00.242310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d1a92483-5f4d-4bae-a8a7-042f8853f9cc tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:00.329812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d1a92483-5f4d-4bae-a8a7-042f8853f9cc tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:00.337354 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d1a92483-5f4d-4bae-a8a7-042f8853f9cc tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1276 microversion: 2.1 time: 0.114412 May 19 14:03:00.337934 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 488/964] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:00 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:00.635163 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7db47e68-5a9d-4bf8-a8a2-0ded785eb476 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:00.635773 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7db47e68-5a9d-4bf8-a8a2-0ded785eb476 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:00.652842 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7db47e68-5a9d-4bf8-a8a2-0ded785eb476 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:00.653831 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7db47e68-5a9d-4bf8-a8a2-0ded785eb476 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:00.655070 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7db47e68-5a9d-4bf8-a8a2-0ded785eb476 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:00.655681 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7db47e68-5a9d-4bf8-a8a2-0ded785eb476 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:00.950588 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7db47e68-5a9d-4bf8-a8a2-0ded785eb476 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:00.960729 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7db47e68-5a9d-4bf8-a8a2-0ded785eb476 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1673 microversion: 2.1 time: 0.329864 May 19 14:03:00.971743 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 477/965] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:00 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1673 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:01.354993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ff5b2306-6456-4a82-8cf6-3a35a7f92e0f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:01.356235 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ff5b2306-6456-4a82-8cf6-3a35a7f92e0f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:01.365689 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ff5b2306-6456-4a82-8cf6-3a35a7f92e0f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:01.366533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ff5b2306-6456-4a82-8cf6-3a35a7f92e0f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:01.367614 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ff5b2306-6456-4a82-8cf6-3a35a7f92e0f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:01.369235 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ff5b2306-6456-4a82-8cf6-3a35a7f92e0f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:01.586974 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-27728ea7-81c3-45f1-9882-87db902715c4 req-a083aa26-d719-4e71-98aa-e616e2dbd5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fe8d4a0-f978-42a1-873f-a34bba7deb96", "tag": "e10b7062-e698-490e-89b8-da759d33b5a4"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:01.611340 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-27728ea7-81c3-45f1-9882-87db902715c4 req-a083aa26-d719-4e71-98aa-e616e2dbd5da service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:01.611780 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-27728ea7-81c3-45f1-9882-87db902715c4 req-a083aa26-d719-4e71-98aa-e616e2dbd5da service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:01.624543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-27728ea7-81c3-45f1-9882-87db902715c4 req-a083aa26-d719-4e71-98aa-e616e2dbd5da service nova] Creating event network-changed:e10b7062-e698-490e-89b8-da759d33b5a4 for instance 2fe8d4a0-f978-42a1-873f-a34bba7deb96 on hv-cinder-78481 May 19 14:03:01.631093 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-27728ea7-81c3-45f1-9882-87db902715c4 req-a083aa26-d719-4e71-98aa-e616e2dbd5da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048622 May 19 14:03:01.631691 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 478/966] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:01.668053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ff5b2306-6456-4a82-8cf6-3a35a7f92e0f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:01.675634 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ff5b2306-6456-4a82-8cf6-3a35a7f92e0f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1318 microversion: 2.1 time: 0.324456 May 19 14:03:01.681307 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 489/967] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:01 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:01.885604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-8446ed1f-ac48-436c-abe8-63e6d7293fdf req-ec04fb59-970e-44d4-aba0-7a59125feb9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5", "name": "network-vif-deleted", "tag": "a2e726ea-bd7a-4b38-921c-644a1035c3fb"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:01.898268 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-8446ed1f-ac48-436c-abe8-63e6d7293fdf req-ec04fb59-970e-44d4-aba0-7a59125feb9a service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:01.899067 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-8446ed1f-ac48-436c-abe8-63e6d7293fdf req-ec04fb59-970e-44d4-aba0-7a59125feb9a service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:01.918454 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-8446ed1f-ac48-436c-abe8-63e6d7293fdf req-ec04fb59-970e-44d4-aba0-7a59125feb9a service nova] Creating event network-vif-deleted:a2e726ea-bd7a-4b38-921c-644a1035c3fb for instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 on hv-cinder-78481 May 19 14:03:01.926418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-8446ed1f-ac48-436c-abe8-63e6d7293fdf req-ec04fb59-970e-44d4-aba0-7a59125feb9a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049499 May 19 14:03:01.930021 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 479/968] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:01.979976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:01.980769 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:01.984010 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:02.000481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:02.002419 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:02.004252 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:02.006341 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:02.052500 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:02.074578 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:02.075478 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:02.076216 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lazy-loading 'fault' on Instance uuid 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:03:02.129472 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:02.153891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ba9ee00a-05dc-47bc-bf3f-572708dc36e8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1327 microversion: 2.1 time: 0.177121 May 19 14:03:02.166679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 490/969] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:01 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1327 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:02.693668 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5a7892bb-4f74-4f5c-812b-c608420f48b3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:02.694593 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5a7892bb-4f74-4f5c-812b-c608420f48b3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:02.700919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a7892bb-4f74-4f5c-812b-c608420f48b3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:02.701365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a7892bb-4f74-4f5c-812b-c608420f48b3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:02.702132 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a7892bb-4f74-4f5c-812b-c608420f48b3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:02.702564 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a7892bb-4f74-4f5c-812b-c608420f48b3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:02.842532 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5a7892bb-4f74-4f5c-812b-c608420f48b3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:02.850494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5a7892bb-4f74-4f5c-812b-c608420f48b3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1318 microversion: 2.1 time: 0.161261 May 19 14:03:02.851106 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 480/970] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:02 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:03.172328 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:03.173659 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:03.180012 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:03.180467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:03.181238 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:03.181679 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:03.214575 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:03.215076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:03.215539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lazy-loading 'fault' on Instance uuid 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:03:03.261531 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:03.270176 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c546c13e-1b3f-407a-8c19-bb16ee894955 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 200 len: 1327 microversion: 2.1 time: 0.101842 May 19 14:03:03.273670 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 491/971] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:03 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 1327 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:03.867928 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-556084ee-46ac-4de6-9732-40c099c20b1f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:03.868546 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-556084ee-46ac-4de6-9732-40c099c20b1f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:03.875832 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-556084ee-46ac-4de6-9732-40c099c20b1f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:03.876516 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-556084ee-46ac-4de6-9732-40c099c20b1f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:03.877302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-556084ee-46ac-4de6-9732-40c099c20b1f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:03.877738 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-556084ee-46ac-4de6-9732-40c099c20b1f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:04.021345 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-556084ee-46ac-4de6-9732-40c099c20b1f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:04.029060 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-556084ee-46ac-4de6-9732-40c099c20b1f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1318 microversion: 2.1 time: 0.164647 May 19 14:03:04.029723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 481/972] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:03 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:04.287992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:04.288587 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:04.295929 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:04.296372 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:04.297166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:04.297599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:04.311204 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] HTTP exception thrown: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Request method failure captured: May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 HTTP/1.1 May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihk1S-tf-0b4m2-9a_IbBNs4f_h-_4iPgz6ZfXcuET3MS3GumBp90VeGvf2ZJeQnmSjbPqxu_XtHjlCK8_Q7XnIZAo13JgfZ3kkc88TByX1HnvvBNZEbLGWWi0nHibVvenY7A_REw9FN4V6m3VL_OOGVWZzyhWtDAn0GuNyVkziyBh-c May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:03:04.312890 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}] May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeTestJSON-1233068734 May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: ab1b34a915464792b5d3b74956bc49a2 May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:03:04.314585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5'} May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:03:04.315583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:03:04.317113 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:04.318467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Returning 404 to user: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:03:04.318467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-395c0298-5233-48fd-9ff5-05af5a084c5c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 404 len: 111 microversion: 2.1 time: 0.030290 May 19 14:03:04.318467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 492/973] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:04 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 14:03:04.323310 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-31fdc218-8d99-4007-82d3-a1e6344fe000 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '.version_select at 0x7f5de1e0ab80>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:04.340938 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-31fdc218-8d99-4007-82d3-a1e6344fe000 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-826849720" status: 202 len: 0 microversion: 2.1 time: 0.021490 May 19 14:03:04.341512 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 482/974] 10.222.0.52 () {58 vars in 1217 bytes} [Thu May 19 14:03:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-826849720 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:03:04.969369 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-00208d1d-6a89-4fb0-85ce-a982131c4c9b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'create', calling method: .version_select at 0x7f5de220d550>, body: {"keypair": {"name": "tempest-keypair-1708554903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPT+cFk36GyOEu01K7+SgSA6Zz+puSDW8jIFipTdgSfYRL5s4WWAQGy8hoOTtZVmfXfXr6jUyBXd2256tKM5NGAkJ7PyY+rXZf9CXAeLRL0NDF+JKUeAchmDhrEK++UVrA=="}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:04.984271 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-00208d1d-6a89-4fb0-85ce-a982131c4c9b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Getting quotas for project e14dac6dd56c4f93b65ad91673debf71. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 14:03:04.988229 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-00208d1d-6a89-4fb0-85ce-a982131c4c9b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Getting quotas for user ab1b34a915464792b5d3b74956bc49a2 and project e14dac6dd56c4f93b65ad91673debf71. Resources: {'key_pairs'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 14:03:05.015066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-00208d1d-6a89-4fb0-85ce-a982131c4c9b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050529 May 19 14:03:05.015886 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 493/975] 10.222.0.52 () {60 vars in 1158 bytes} [Thu May 19 14:03:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:05.049450 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-abd6e8dc-207d-43cb-86cf-150a3e21c92f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:05.050688 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-abd6e8dc-207d-43cb-86cf-150a3e21c92f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:05.058387 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abd6e8dc-207d-43cb-86cf-150a3e21c92f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:05.058944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abd6e8dc-207d-43cb-86cf-150a3e21c92f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:05.059764 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abd6e8dc-207d-43cb-86cf-150a3e21c92f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:05.060257 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abd6e8dc-207d-43cb-86cf-150a3e21c92f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:05.517503 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-abd6e8dc-207d-43cb-86cf-150a3e21c92f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:05.527211 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-abd6e8dc-207d-43cb-86cf-150a3e21c92f tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1318 microversion: 2.1 time: 0.484076 May 19 14:03:05.529013 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 483/976] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:05 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:06.473601 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1572129676", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1f8bcd1c-fe6c-418c-88b6-9ed5b3ff968d"}], "security_groups": [{"name": "tempest-securitygroup--416608653"}], "key_name": "tempest-keypair-1708554903", "user_data": "}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:06.544515 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3e6bcc7b-91ac-49e5-9fa5-9790796e7df3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:06.545430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3e6bcc7b-91ac-49e5-9fa5-9790796e7df3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:06.553605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e6bcc7b-91ac-49e5-9fa5-9790796e7df3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:06.554212 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e6bcc7b-91ac-49e5-9fa5-9790796e7df3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:06.554983 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e6bcc7b-91ac-49e5-9fa5-9790796e7df3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:06.555426 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e6bcc7b-91ac-49e5-9fa5-9790796e7df3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:06.587005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] validate_networks() for [('1f8bcd1c-fe6c-418c-88b6-9ed5b3ff968d', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 14:03:06.778178 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3e6bcc7b-91ac-49e5-9fa5-9790796e7df3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:06.786696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3e6bcc7b-91ac-49e5-9fa5-9790796e7df3 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1318 microversion: 2.1 time: 0.246199 May 19 14:03:06.787441 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 484/977] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:06 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:06.794533 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:07.049551 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 14:03:07.049963 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 14:03:07.054668 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 14:03:07.055182 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 14:03:07.055618 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 14:03:07.065928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:07.066389 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:07.067522 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:07.067854 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:07.093087 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Getting quotas for project e14dac6dd56c4f93b65ad91673debf71. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 14:03:07.097450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Getting quotas for user ab1b34a915464792b5d3b74956bc49a2 and project e14dac6dd56c4f93b65ad91673debf71. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 14:03:07.112390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 14:03:07.114691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 14:03:07.163991 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-80ef8f55-3bdc-4395-b509-9de8fbd5f79e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.695329 May 19 14:03:07.165062 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 494/978] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 14:03:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 14:03:07.176799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-06fbe82e-d66e-4ac9-bd0e-6e232622c65a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:07.177426 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-06fbe82e-d66e-4ac9-bd0e-6e232622c65a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:07.181196 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=6 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:07.196815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-44aec508-37c4-401f-9a24-264b5329ceec req-39aa4261-8951-48e9-a9cf-22a004476aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe8d4a0-f978-42a1-873f-a34bba7deb96", "name": "network-vif-plugged", "status": "completed", "tag": "e10b7062-e698-490e-89b8-da759d33b5a4"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:07.208997 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-44aec508-37c4-401f-9a24-264b5329ceec req-39aa4261-8951-48e9-a9cf-22a004476aff service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:07.209692 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-44aec508-37c4-401f-9a24-264b5329ceec req-39aa4261-8951-48e9-a9cf-22a004476aff service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:07.228339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-44aec508-37c4-401f-9a24-264b5329ceec req-39aa4261-8951-48e9-a9cf-22a004476aff service nova] Creating event network-vif-plugged:e10b7062-e698-490e-89b8-da759d33b5a4 for instance 2fe8d4a0-f978-42a1-873f-a34bba7deb96 on hv-cinder-78481 May 19 14:03:07.240610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-06fbe82e-d66e-4ac9-bd0e-6e232622c65a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:07.249788 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-06fbe82e-d66e-4ac9-bd0e-6e232622c65a tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1238 microversion: 2.1 time: 0.078248 May 19 14:03:07.251982 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-44aec508-37c4-401f-9a24-264b5329ceec req-39aa4261-8951-48e9-a9cf-22a004476aff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057112 May 19 14:03:07.252729 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 485/979] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:07 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:07.252857 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 495/980] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:03:07.807677 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a34322b0-a63b-449b-8b3e-68c978b6e944 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:07.808385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a34322b0-a63b-449b-8b3e-68c978b6e944 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:07.815334 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a34322b0-a63b-449b-8b3e-68c978b6e944 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:07.815986 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a34322b0-a63b-449b-8b3e-68c978b6e944 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:07.817237 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a34322b0-a63b-449b-8b3e-68c978b6e944 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:07.817237 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a34322b0-a63b-449b-8b3e-68c978b6e944 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:07.958304 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a34322b0-a63b-449b-8b3e-68c978b6e944 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:07.965968 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a34322b0-a63b-449b-8b3e-68c978b6e944 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1318 microversion: 2.1 time: 0.164032 May 19 14:03:07.966542 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 496/981] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:07 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:08.270215 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-087e2a8b-e981-4f37-8065-3078d99c7ea9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:08.270924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-087e2a8b-e981-4f37-8065-3078d99c7ea9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:08.277591 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-087e2a8b-e981-4f37-8065-3078d99c7ea9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:08.278038 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-087e2a8b-e981-4f37-8065-3078d99c7ea9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:08.278801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-087e2a8b-e981-4f37-8065-3078d99c7ea9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:08.279317 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-087e2a8b-e981-4f37-8065-3078d99c7ea9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:08.344624 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-087e2a8b-e981-4f37-8065-3078d99c7ea9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:08.352391 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-087e2a8b-e981-4f37-8065-3078d99c7ea9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1234 microversion: 2.1 time: 0.086191 May 19 14:03:08.353218 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 486/982] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:08 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1234 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:08.982767 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e7f00386-d7de-4315-a3c0-c017393b29c1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:08.983407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e7f00386-d7de-4315-a3c0-c017393b29c1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:08.990803 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e7f00386-d7de-4315-a3c0-c017393b29c1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:08.991284 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e7f00386-d7de-4315-a3c0-c017393b29c1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:08.992077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e7f00386-d7de-4315-a3c0-c017393b29c1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:08.992516 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e7f00386-d7de-4315-a3c0-c017393b29c1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:09.129070 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-e7f00386-d7de-4315-a3c0-c017393b29c1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:09.136771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e7f00386-d7de-4315-a3c0-c017393b29c1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1507 microversion: 2.1 time: 0.157989 May 19 14:03:09.137328 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 497/983] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:08 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:09.152909 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6025d3a0-6fc6-41c3-936e-9fec4b298cae tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28dc7cf5-2e9c-428e-b130-97862490072c", "device": "/dev/sdb"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:09.154475 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6025d3a0-6fc6-41c3-936e-9fec4b298cae tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:09.160578 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6025d3a0-6fc6-41c3-936e-9fec4b298cae tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:09.161027 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6025d3a0-6fc6-41c3-936e-9fec4b298cae tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:09.161790 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6025d3a0-6fc6-41c3-936e-9fec4b298cae tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:09.162226 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6025d3a0-6fc6-41c3-936e-9fec4b298cae tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:09.370515 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-019590f6-8082-4f21-808f-6f879cd724aa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:09.371712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-019590f6-8082-4f21-808f-6f879cd724aa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:09.380285 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-019590f6-8082-4f21-808f-6f879cd724aa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:09.381129 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-019590f6-8082-4f21-808f-6f879cd724aa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:09.403140 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-019590f6-8082-4f21-808f-6f879cd724aa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:09.403847 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-019590f6-8082-4f21-808f-6f879cd724aa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:09.494809 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-019590f6-8082-4f21-808f-6f879cd724aa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:09.503597 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-019590f6-8082-4f21-808f-6f879cd724aa tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1308 microversion: 2.1 time: 0.136835 May 19 14:03:09.504252 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 498/984] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:09 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:09.582116 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6025d3a0-6fc6-41c3-936e-9fec4b298cae tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "POST /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433005 May 19 14:03:09.583358 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 487/985] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 14:03:09 2022] POST /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96/os-volume_attachments => generated 194 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:10.521930 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c4d32df8-92db-4073-8779-7fd1b24c1051 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:10.522538 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c4d32df8-92db-4073-8779-7fd1b24c1051 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:10.531518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c4d32df8-92db-4073-8779-7fd1b24c1051 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:10.531971 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c4d32df8-92db-4073-8779-7fd1b24c1051 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:10.532760 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c4d32df8-92db-4073-8779-7fd1b24c1051 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:10.533252 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c4d32df8-92db-4073-8779-7fd1b24c1051 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:10.698370 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c4d32df8-92db-4073-8779-7fd1b24c1051 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:10.707109 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c4d32df8-92db-4073-8779-7fd1b24c1051 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1363 microversion: 2.1 time: 0.189072 May 19 14:03:10.707672 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 499/986] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:10 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:11.106249 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-219d1ba5-408e-482c-b021-f0ed8c800f51 req-ad07bab6-889c-4e92-ac28-4185599ed0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65d85b2-643f-4802-bef7-c9f9891f7edd", "tag": "5d7c81fc-927f-4959-bc8f-48bd05561155"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:11.117799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-219d1ba5-408e-482c-b021-f0ed8c800f51 req-ad07bab6-889c-4e92-ac28-4185599ed0ec service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:11.118253 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-219d1ba5-408e-482c-b021-f0ed8c800f51 req-ad07bab6-889c-4e92-ac28-4185599ed0ec service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:11.130446 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-219d1ba5-408e-482c-b021-f0ed8c800f51 req-ad07bab6-889c-4e92-ac28-4185599ed0ec service nova] Creating event network-changed:5d7c81fc-927f-4959-bc8f-48bd05561155 for instance a65d85b2-643f-4802-bef7-c9f9891f7edd on hv-cinder-78481 May 19 14:03:11.135664 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-219d1ba5-408e-482c-b021-f0ed8c800f51 req-ad07bab6-889c-4e92-ac28-4185599ed0ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038458 May 19 14:03:11.136205 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 488/987] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:11.724643 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4ce640cd-cb33-4673-9973-60e1a20df59e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:11.725344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4ce640cd-cb33-4673-9973-60e1a20df59e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:11.731871 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4ce640cd-cb33-4673-9973-60e1a20df59e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:11.732322 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4ce640cd-cb33-4673-9973-60e1a20df59e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:11.733121 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4ce640cd-cb33-4673-9973-60e1a20df59e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:11.733549 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4ce640cd-cb33-4673-9973-60e1a20df59e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:11.866602 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4ce640cd-cb33-4673-9973-60e1a20df59e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:11.874197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4ce640cd-cb33-4673-9973-60e1a20df59e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1363 microversion: 2.1 time: 0.153348 May 19 14:03:11.874762 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 500/988] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:11 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:12.892710 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3c532de1-6d5e-4973-b060-a9a7cdb94f7c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:12.893563 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3c532de1-6d5e-4973-b060-a9a7cdb94f7c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:12.899869 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3c532de1-6d5e-4973-b060-a9a7cdb94f7c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:12.900321 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3c532de1-6d5e-4973-b060-a9a7cdb94f7c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:12.901425 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3c532de1-6d5e-4973-b060-a9a7cdb94f7c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:12.901871 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3c532de1-6d5e-4973-b060-a9a7cdb94f7c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:13.039502 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3c532de1-6d5e-4973-b060-a9a7cdb94f7c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:13.048543 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3c532de1-6d5e-4973-b060-a9a7cdb94f7c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1363 microversion: 2.1 time: 0.160625 May 19 14:03:13.057849 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 489/989] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:12 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:14.065877 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-f9d094a6-6b88-4fdb-9428-e3dfbba81a6b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:14.066501 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-f9d094a6-6b88-4fdb-9428-e3dfbba81a6b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:14.072921 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9d094a6-6b88-4fdb-9428-e3dfbba81a6b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:14.073382 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9d094a6-6b88-4fdb-9428-e3dfbba81a6b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:14.074358 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9d094a6-6b88-4fdb-9428-e3dfbba81a6b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:14.074988 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-f9d094a6-6b88-4fdb-9428-e3dfbba81a6b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:14.228519 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-f9d094a6-6b88-4fdb-9428-e3dfbba81a6b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:14.236698 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-f9d094a6-6b88-4fdb-9428-e3dfbba81a6b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1363 microversion: 2.1 time: 0.175057 May 19 14:03:14.238896 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 501/990] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:14 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:15.211850 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-be9f4d09-1270-476f-9712-b27a470c7360 req-4712ec92-648d-4da4-8127-103f55f637b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65d85b2-643f-4802-bef7-c9f9891f7edd", "name": "network-vif-plugged", "status": "completed", "tag": "5d7c81fc-927f-4959-bc8f-48bd05561155"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:15.220935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-be9f4d09-1270-476f-9712-b27a470c7360 req-4712ec92-648d-4da4-8127-103f55f637b2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:15.221379 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-be9f4d09-1270-476f-9712-b27a470c7360 req-4712ec92-648d-4da4-8127-103f55f637b2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:15.232760 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-be9f4d09-1270-476f-9712-b27a470c7360 req-4712ec92-648d-4da4-8127-103f55f637b2 service nova] Creating event network-vif-plugged:5d7c81fc-927f-4959-bc8f-48bd05561155 for instance a65d85b2-643f-4802-bef7-c9f9891f7edd on hv-cinder-78481 May 19 14:03:15.238316 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-be9f4d09-1270-476f-9712-b27a470c7360 req-4712ec92-648d-4da4-8127-103f55f637b2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030067 May 19 14:03:15.239110 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 490/991] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:15.253976 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bb324402-9580-44aa-b2fa-a3f488eb8da9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:15.254619 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bb324402-9580-44aa-b2fa-a3f488eb8da9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:15.261633 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bb324402-9580-44aa-b2fa-a3f488eb8da9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:15.262393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bb324402-9580-44aa-b2fa-a3f488eb8da9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:15.263232 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bb324402-9580-44aa-b2fa-a3f488eb8da9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:15.263844 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bb324402-9580-44aa-b2fa-a3f488eb8da9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:15.404762 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-840006920", "imageRef": "49c83814-ca0c-41d5-98b4-73a57656e5d4", "flavorRef": "452"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:15.435382 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-bb324402-9580-44aa-b2fa-a3f488eb8da9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:15.444324 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bb324402-9580-44aa-b2fa-a3f488eb8da9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1363 microversion: 2.1 time: 0.194980 May 19 14:03:15.445283 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 502/992] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:15 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:15.460745 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] validate_networks() for None {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 14:03:15.734129 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 14:03:15.734550 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 14:03:15.735081 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 14:03:15.735485 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 14:03:15.735900 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 14:03:15.747705 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:15.748289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:15.749293 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:15.749920 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:15.768319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Getting quotas for project 8f658c67bd7245eaaadf3f969fc562b5. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 14:03:15.772437 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Getting quotas for user 5db2bab7613543bbab2db936926966b3 and project 8f658c67bd7245eaaadf3f969fc562b5. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 14:03:15.784605 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 14:03:15.786971 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='49c83814-ca0c-41d5-98b4-73a57656e5d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 14:03:15.832922 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cd5614b2-7ad1-4d3a-a2fe-8def77585614 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.434654 May 19 14:03:15.833558 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 491/993] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 14:03:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 14:03:15.843873 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8eea67be-0ba8-44e0-bf7e-a6bf27e4a029 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:15.844768 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8eea67be-0ba8-44e0-bf7e-a6bf27e4a029 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:15.904554 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8eea67be-0ba8-44e0-bf7e-a6bf27e4a029 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:15.911360 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8eea67be-0ba8-44e0-bf7e-a6bf27e4a029 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1214 microversion: 2.1 time: 0.071156 May 19 14:03:15.914909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 503/994] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:15 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:16.088375 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-131846455", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-37618688", "security_groups": [{"name": "tempest-secgroup-smoke-860494061"}], "block_device_mapping_v2": [{"uuid": "16ee907b-e640-4e6f-8b13-52d4308b3fb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa748ea7-654e-47dd-89a8-e6366b098088"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:16.203520 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] validate_networks() for [('aa748ea7-654e-47dd-89a8-e6366b098088', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 14:03:16.461230 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5074ff06-09fb-484b-b184-af860e193e01 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:16.461838 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5074ff06-09fb-484b-b184-af860e193e01 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:16.469095 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5074ff06-09fb-484b-b184-af860e193e01 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:16.469726 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5074ff06-09fb-484b-b184-af860e193e01 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:16.470486 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5074ff06-09fb-484b-b184-af860e193e01 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:16.471021 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5074ff06-09fb-484b-b184-af860e193e01 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:16.623693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 14:03:16.624201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 14:03:16.624626 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 14:03:16.625105 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 14:03:16.625525 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 14:03:16.634414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:16.635043 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:16.635708 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:16.636179 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:16.649136 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5074ff06-09fb-484b-b184-af860e193e01 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:16.654046 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Getting quotas for project 6d87d3963b1b4fb29e09d8f72f64fb6e. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 14:03:16.657127 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5074ff06-09fb-484b-b184-af860e193e01 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1363 microversion: 2.1 time: 0.199740 May 19 14:03:16.657702 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 504/995] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:16 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:03:16.658372 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Getting quotas for user df54f67274d24463961e1f48dcb37447 and project 6d87d3963b1b4fb29e09d8f72f64fb6e. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 14:03:16.717045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 14:03:16.719803 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16ee907b-e640-4e6f-8b13-52d4308b3fb2',volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 14:03:16.846019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5539fa7a-a76b-4f46-83a0-6df8f4240434 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.761428 May 19 14:03:16.846680 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 492/996] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 14:03:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 14:03:16.856766 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3c8ab7a6-df99-43a7-be4f-3b8915e595d7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:16.857527 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3c8ab7a6-df99-43a7-be4f-3b8915e595d7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:16.917708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3c8ab7a6-df99-43a7-be4f-3b8915e595d7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:16.924859 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3c8ab7a6-df99-43a7-be4f-3b8915e595d7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1092 microversion: 2.1 time: 0.072023 May 19 14:03:16.925638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 505/997] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:16 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1092 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:16.930284 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-269feca7-557f-446a-9ab2-62c46da42688 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:16.930933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-269feca7-557f-446a-9ab2-62c46da42688 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:16.937924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269feca7-557f-446a-9ab2-62c46da42688 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:16.938615 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269feca7-557f-446a-9ab2-62c46da42688 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:16.939430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269feca7-557f-446a-9ab2-62c46da42688 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:16.939827 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-269feca7-557f-446a-9ab2-62c46da42688 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:17.014405 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-269feca7-557f-446a-9ab2-62c46da42688 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:17.024585 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-269feca7-557f-446a-9ab2-62c46da42688 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1210 microversion: 2.1 time: 0.099698 May 19 14:03:17.025662 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 493/998] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:16 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:03:17.673591 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-108096d3-2b1b-4ee6-8dde-60c14bd38ff7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:17.674314 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-108096d3-2b1b-4ee6-8dde-60c14bd38ff7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:17.676443 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:17.682840 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-108096d3-2b1b-4ee6-8dde-60c14bd38ff7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:17.683399 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-108096d3-2b1b-4ee6-8dde-60c14bd38ff7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:17.684251 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-108096d3-2b1b-4ee6-8dde-60c14bd38ff7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:17.684762 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-108096d3-2b1b-4ee6-8dde-60c14bd38ff7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:17.826554 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-108096d3-2b1b-4ee6-8dde-60c14bd38ff7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:17.834987 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-108096d3-2b1b-4ee6-8dde-60c14bd38ff7 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1548 microversion: 2.1 time: 0.165267 May 19 14:03:17.835567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 506/999] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:17 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:17.852401 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-be75d0f0-46f7-4cd8-98da-f66258a3ad7e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:17.852945 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-be75d0f0-46f7-4cd8-98da-f66258a3ad7e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:17.859450 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be75d0f0-46f7-4cd8-98da-f66258a3ad7e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:17.859910 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be75d0f0-46f7-4cd8-98da-f66258a3ad7e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:17.860687 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be75d0f0-46f7-4cd8-98da-f66258a3ad7e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:17.861132 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be75d0f0-46f7-4cd8-98da-f66258a3ad7e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:17.942484 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9149d6f9-cf9b-44c0-b654-96324a70f731 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:17.942675 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-be75d0f0-46f7-4cd8-98da-f66258a3ad7e tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095528 May 19 14:03:17.943133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9149d6f9-cf9b-44c0-b654-96324a70f731 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:17.946171 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 494/1000] 10.222.0.52 () {58 vars in 1274 bytes} [Thu May 19 14:03:17 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:17.949237 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9149d6f9-cf9b-44c0-b654-96324a70f731 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:17.949697 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9149d6f9-cf9b-44c0-b654-96324a70f731 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:17.950482 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9149d6f9-cf9b-44c0-b654-96324a70f731 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:17.950951 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9149d6f9-cf9b-44c0-b654-96324a70f731 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:18.025275 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9149d6f9-cf9b-44c0-b654-96324a70f731 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:18.033196 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9149d6f9-cf9b-44c0-b654-96324a70f731 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1190 microversion: 2.1 time: 0.094389 May 19 14:03:18.033703 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 507/1001] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:17 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:03:18.041826 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0d330f3b-a732-479b-a356-3798c089f5e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:18.042631 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0d330f3b-a732-479b-a356-3798c089f5e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:18.049603 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0d330f3b-a732-479b-a356-3798c089f5e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:18.050058 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0d330f3b-a732-479b-a356-3798c089f5e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:18.050833 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0d330f3b-a732-479b-a356-3798c089f5e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:18.051304 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0d330f3b-a732-479b-a356-3798c089f5e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:18.071630 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:18.153436 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0d330f3b-a732-479b-a356-3798c089f5e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:18.165906 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0d330f3b-a732-479b-a356-3798c089f5e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1274 microversion: 2.1 time: 0.127656 May 19 14:03:18.167469 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 495/1002] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:18 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:19.053807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-756c9542-3a6b-4d25-b880-2b51d0679f35 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:19.055118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-756c9542-3a6b-4d25-b880-2b51d0679f35 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:19.063157 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-756c9542-3a6b-4d25-b880-2b51d0679f35 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:19.063678 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-756c9542-3a6b-4d25-b880-2b51d0679f35 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:19.064657 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-756c9542-3a6b-4d25-b880-2b51d0679f35 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:19.065104 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-756c9542-3a6b-4d25-b880-2b51d0679f35 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:19.154585 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-756c9542-3a6b-4d25-b880-2b51d0679f35 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:19.163764 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-756c9542-3a6b-4d25-b880-2b51d0679f35 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1208 microversion: 2.1 time: 0.117486 May 19 14:03:19.174118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 508/1003] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:19 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1208 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:19.188678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ba2ab307-2b64-4d4c-9177-cf4c546d3c70 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:19.189296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ba2ab307-2b64-4d4c-9177-cf4c546d3c70 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:19.199570 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ba2ab307-2b64-4d4c-9177-cf4c546d3c70 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:19.200023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ba2ab307-2b64-4d4c-9177-cf4c546d3c70 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:19.200811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ba2ab307-2b64-4d4c-9177-cf4c546d3c70 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:19.201251 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ba2ab307-2b64-4d4c-9177-cf4c546d3c70 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:19.208033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-16fd2c50-b326-4752-abed-d953d7f00975 req-607233d0-a772-4760-b276-5d928bf58da5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a65d85b2-643f-4802-bef7-c9f9891f7edd", "tag": "5d7c81fc-927f-4959-bc8f-48bd05561155"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:19.216194 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-16fd2c50-b326-4752-abed-d953d7f00975 req-607233d0-a772-4760-b276-5d928bf58da5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:19.216770 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-16fd2c50-b326-4752-abed-d953d7f00975 req-607233d0-a772-4760-b276-5d928bf58da5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:19.231686 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-16fd2c50-b326-4752-abed-d953d7f00975 req-607233d0-a772-4760-b276-5d928bf58da5 service nova] Creating event network-changed:5d7c81fc-927f-4959-bc8f-48bd05561155 for instance a65d85b2-643f-4802-bef7-c9f9891f7edd on hv-cinder-78481 May 19 14:03:19.244632 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-16fd2c50-b326-4752-abed-d953d7f00975 req-607233d0-a772-4760-b276-5d928bf58da5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041168 May 19 14:03:19.245546 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 509/1004] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:03:19.628317 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ba2ab307-2b64-4d4c-9177-cf4c546d3c70 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:19.635954 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ba2ab307-2b64-4d4c-9177-cf4c546d3c70 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.453789 May 19 14:03:19.636508 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 496/1005] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:19 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:20.182132 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-155b89ca-e047-4923-8d3f-33412e1170d6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:20.182853 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-155b89ca-e047-4923-8d3f-33412e1170d6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:20.190298 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-155b89ca-e047-4923-8d3f-33412e1170d6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:20.190774 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-155b89ca-e047-4923-8d3f-33412e1170d6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:20.191567 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-155b89ca-e047-4923-8d3f-33412e1170d6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:20.192015 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-155b89ca-e047-4923-8d3f-33412e1170d6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:20.256135 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-155b89ca-e047-4923-8d3f-33412e1170d6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:20.263876 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-155b89ca-e047-4923-8d3f-33412e1170d6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1208 microversion: 2.1 time: 0.086393 May 19 14:03:20.264483 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 510/1006] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:20 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1208 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:20.653610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-80b5fefc-a8f7-4831-894c-ff00208bb943 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:20.654219 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-80b5fefc-a8f7-4831-894c-ff00208bb943 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:20.661353 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-80b5fefc-a8f7-4831-894c-ff00208bb943 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:20.661797 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-80b5fefc-a8f7-4831-894c-ff00208bb943 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:20.662560 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-80b5fefc-a8f7-4831-894c-ff00208bb943 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:20.663089 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-80b5fefc-a8f7-4831-894c-ff00208bb943 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:20.791181 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-80b5fefc-a8f7-4831-894c-ff00208bb943 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:20.799191 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-80b5fefc-a8f7-4831-894c-ff00208bb943 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.149403 May 19 14:03:20.799753 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 497/1007] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:20 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:21.281807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1ca2728d-aa09-436e-91de-4765a8fdc8bc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:21.282415 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1ca2728d-aa09-436e-91de-4765a8fdc8bc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:21.288933 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1ca2728d-aa09-436e-91de-4765a8fdc8bc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:21.289386 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1ca2728d-aa09-436e-91de-4765a8fdc8bc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:21.290147 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1ca2728d-aa09-436e-91de-4765a8fdc8bc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:21.290581 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1ca2728d-aa09-436e-91de-4765a8fdc8bc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:21.350598 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1ca2728d-aa09-436e-91de-4765a8fdc8bc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:21.352885 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=100 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:21.359432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1ca2728d-aa09-436e-91de-4765a8fdc8bc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1208 microversion: 2.1 time: 0.081909 May 19 14:03:21.359997 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 511/1008] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:21 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:21.819347 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-98909040-d306-457c-8ff6-cb16d55a0cc1 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:21.820819 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-98909040-d306-457c-8ff6-cb16d55a0cc1 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:21.829618 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:21.839772 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98909040-d306-457c-8ff6-cb16d55a0cc1 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:21.841336 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98909040-d306-457c-8ff6-cb16d55a0cc1 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:21.842398 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98909040-d306-457c-8ff6-cb16d55a0cc1 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:21.843736 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98909040-d306-457c-8ff6-cb16d55a0cc1 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:22.135028 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98909040-d306-457c-8ff6-cb16d55a0cc1 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:22.147458 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-98909040-d306-457c-8ff6-cb16d55a0cc1 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.333594 May 19 14:03:22.148692 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 498/1009] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:21 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:22.202271 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-5c2bc867-3819-4e77-b482-610517ae1a52 req-ed3d8581-1695-4845-8695-5cfff9630d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8ef2420-d67d-4a41-9fe6-9d19390222f7", "tag": "6a160eb6-ce50-409b-a90b-42d195382f7b"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:22.219351 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-5c2bc867-3819-4e77-b482-610517ae1a52 req-ed3d8581-1695-4845-8695-5cfff9630d84 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:22.219800 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-5c2bc867-3819-4e77-b482-610517ae1a52 req-ed3d8581-1695-4845-8695-5cfff9630d84 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:22.231652 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-5c2bc867-3819-4e77-b482-610517ae1a52 req-ed3d8581-1695-4845-8695-5cfff9630d84 service nova] Creating event network-changed:6a160eb6-ce50-409b-a90b-42d195382f7b for instance d8ef2420-d67d-4a41-9fe6-9d19390222f7 on hv-cinder-78481 May 19 14:03:22.259394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-5c2bc867-3819-4e77-b482-610517ae1a52 req-ed3d8581-1695-4845-8695-5cfff9630d84 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057574 May 19 14:03:22.260033 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 512/1010] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:22.378907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cf5cb16a-55f5-416a-9096-7a88e6e4e9f6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:22.379715 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cf5cb16a-55f5-416a-9096-7a88e6e4e9f6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:22.410064 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf5cb16a-55f5-416a-9096-7a88e6e4e9f6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:22.410666 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf5cb16a-55f5-416a-9096-7a88e6e4e9f6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:22.411618 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf5cb16a-55f5-416a-9096-7a88e6e4e9f6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:22.412285 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cf5cb16a-55f5-416a-9096-7a88e6e4e9f6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:22.770947 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cf5cb16a-55f5-416a-9096-7a88e6e4e9f6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:22.778825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cf5cb16a-55f5-416a-9096-7a88e6e4e9f6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1275 microversion: 2.1 time: 0.405665 May 19 14:03:22.780028 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 499/1011] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:22 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1275 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:23.166270 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-aadfebfc-b671-4e73-9c1c-ce5aea4e9aae tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:23.167053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-aadfebfc-b671-4e73-9c1c-ce5aea4e9aae tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:23.173993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-aadfebfc-b671-4e73-9c1c-ce5aea4e9aae tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:23.174377 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-aadfebfc-b671-4e73-9c1c-ce5aea4e9aae tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:23.175737 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-aadfebfc-b671-4e73-9c1c-ce5aea4e9aae tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:23.176365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-aadfebfc-b671-4e73-9c1c-ce5aea4e9aae tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:23.387796 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-aadfebfc-b671-4e73-9c1c-ce5aea4e9aae tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:23.403825 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-aadfebfc-b671-4e73-9c1c-ce5aea4e9aae tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.242336 May 19 14:03:23.404422 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 513/1012] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:23 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:23.526416 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-b105a79e-5f37-4abe-bf38-0b144afb5397 req-3d7f97df-c220-4c1e-947d-40fdbb40d3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfea4879-afb7-4f52-99f6-c666d214000d", "tag": "2888e720-a274-4cb2-91e2-5264abb78eda"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:23.536726 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-b105a79e-5f37-4abe-bf38-0b144afb5397 req-3d7f97df-c220-4c1e-947d-40fdbb40d3aa service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:23.537164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-b105a79e-5f37-4abe-bf38-0b144afb5397 req-3d7f97df-c220-4c1e-947d-40fdbb40d3aa service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:23.550478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-b105a79e-5f37-4abe-bf38-0b144afb5397 req-3d7f97df-c220-4c1e-947d-40fdbb40d3aa service nova] Creating event network-changed:2888e720-a274-4cb2-91e2-5264abb78eda for instance bfea4879-afb7-4f52-99f6-c666d214000d on hv-cinder-78481 May 19 14:03:23.555434 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-b105a79e-5f37-4abe-bf38-0b144afb5397 req-3d7f97df-c220-4c1e-947d-40fdbb40d3aa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034930 May 19 14:03:23.556032 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 500/1013] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:23.796756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0f16dd86-d1dd-46c6-808d-cc9fc5f39c04 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:23.797539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0f16dd86-d1dd-46c6-808d-cc9fc5f39c04 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:23.803593 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0f16dd86-d1dd-46c6-808d-cc9fc5f39c04 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:23.804051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0f16dd86-d1dd-46c6-808d-cc9fc5f39c04 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:23.804818 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0f16dd86-d1dd-46c6-808d-cc9fc5f39c04 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:23.805261 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0f16dd86-d1dd-46c6-808d-cc9fc5f39c04 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:23.933509 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-0f16dd86-d1dd-46c6-808d-cc9fc5f39c04 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:23.941646 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0f16dd86-d1dd-46c6-808d-cc9fc5f39c04 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.148901 May 19 14:03:23.942213 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 514/1014] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:23 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:24.422718 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f4b22391-2b09-4888-bdb3-005c8c6d6306 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:24.423430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f4b22391-2b09-4888-bdb3-005c8c6d6306 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:24.429619 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4b22391-2b09-4888-bdb3-005c8c6d6306 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:24.430059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4b22391-2b09-4888-bdb3-005c8c6d6306 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:24.430811 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4b22391-2b09-4888-bdb3-005c8c6d6306 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:24.431268 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4b22391-2b09-4888-bdb3-005c8c6d6306 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:24.568316 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f4b22391-2b09-4888-bdb3-005c8c6d6306 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:24.576639 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f4b22391-2b09-4888-bdb3-005c8c6d6306 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.158736 May 19 14:03:24.577213 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 501/1015] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:24 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:24.958828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-481b2ba4-3bfa-43bf-8e59-63ca43b8f49e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:24.959548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-481b2ba4-3bfa-43bf-8e59-63ca43b8f49e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:24.967741 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-481b2ba4-3bfa-43bf-8e59-63ca43b8f49e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:24.969197 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-481b2ba4-3bfa-43bf-8e59-63ca43b8f49e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:24.970486 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-481b2ba4-3bfa-43bf-8e59-63ca43b8f49e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:24.971292 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-481b2ba4-3bfa-43bf-8e59-63ca43b8f49e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:25.121250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-481b2ba4-3bfa-43bf-8e59-63ca43b8f49e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:25.130747 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-481b2ba4-3bfa-43bf-8e59-63ca43b8f49e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.175771 May 19 14:03:25.131743 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 515/1016] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:24 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:25.594120 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b3b2e20a-e797-4d2f-8218-8b273b06f23d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:25.594754 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b3b2e20a-e797-4d2f-8218-8b273b06f23d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:25.601303 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b3b2e20a-e797-4d2f-8218-8b273b06f23d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:25.601756 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b3b2e20a-e797-4d2f-8218-8b273b06f23d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:25.602513 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b3b2e20a-e797-4d2f-8218-8b273b06f23d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:25.602972 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b3b2e20a-e797-4d2f-8218-8b273b06f23d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:25.775137 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b3b2e20a-e797-4d2f-8218-8b273b06f23d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:25.783257 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b3b2e20a-e797-4d2f-8218-8b273b06f23d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.193718 May 19 14:03:25.783830 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 502/1017] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:25 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:26.149168 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8a8d6287-bd77-4846-a3bf-1b8bfe2eebca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:26.149775 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8a8d6287-bd77-4846-a3bf-1b8bfe2eebca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:26.156262 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8a8d6287-bd77-4846-a3bf-1b8bfe2eebca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:26.156711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8a8d6287-bd77-4846-a3bf-1b8bfe2eebca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:26.157603 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8a8d6287-bd77-4846-a3bf-1b8bfe2eebca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:26.157900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8a8d6287-bd77-4846-a3bf-1b8bfe2eebca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:26.294184 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-8a8d6287-bd77-4846-a3bf-1b8bfe2eebca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:26.302319 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8a8d6287-bd77-4846-a3bf-1b8bfe2eebca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.156933 May 19 14:03:26.302904 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 516/1018] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:26 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:26.799037 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ab6e47e7-f74e-4462-a53d-0bb57c4d2bb2 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:26.799659 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ab6e47e7-f74e-4462-a53d-0bb57c4d2bb2 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:26.802056 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=4 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:26.802903 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=14 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:26.808820 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab6e47e7-f74e-4462-a53d-0bb57c4d2bb2 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:26.809267 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab6e47e7-f74e-4462-a53d-0bb57c4d2bb2 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:26.810037 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab6e47e7-f74e-4462-a53d-0bb57c4d2bb2 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:26.810468 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab6e47e7-f74e-4462-a53d-0bb57c4d2bb2 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:27.027438 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ab6e47e7-f74e-4462-a53d-0bb57c4d2bb2 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:27.035613 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ab6e47e7-f74e-4462-a53d-0bb57c4d2bb2 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.240478 May 19 14:03:27.036192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 503/1019] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:26 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:27.319061 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d3804846-bcfa-4391-a37e-0cf67e3e3a92 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:27.319680 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d3804846-bcfa-4391-a37e-0cf67e3e3a92 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:27.321621 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=20 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:27.327547 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d3804846-bcfa-4391-a37e-0cf67e3e3a92 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:27.328053 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d3804846-bcfa-4391-a37e-0cf67e3e3a92 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:27.328831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d3804846-bcfa-4391-a37e-0cf67e3e3a92 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:27.329268 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d3804846-bcfa-4391-a37e-0cf67e3e3a92 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:27.461566 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d3804846-bcfa-4391-a37e-0cf67e3e3a92 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:27.469728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d3804846-bcfa-4391-a37e-0cf67e3e3a92 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.154533 May 19 14:03:27.470299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 517/1020] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:27 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:28.053058 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0d29d077-84a5-4f53-a777-76980bdfe63a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:28.053669 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0d29d077-84a5-4f53-a777-76980bdfe63a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:28.060343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0d29d077-84a5-4f53-a777-76980bdfe63a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:28.060787 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0d29d077-84a5-4f53-a777-76980bdfe63a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:28.061544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0d29d077-84a5-4f53-a777-76980bdfe63a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:28.062718 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0d29d077-84a5-4f53-a777-76980bdfe63a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:28.191706 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0d29d077-84a5-4f53-a777-76980bdfe63a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:28.199154 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0d29d077-84a5-4f53-a777-76980bdfe63a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.149770 May 19 14:03:28.199712 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 504/1021] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:28 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:28.487224 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-81b3fa1f-eee4-4615-8048-f38144953fb1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:28.487766 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-81b3fa1f-eee4-4615-8048-f38144953fb1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:28.494174 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-81b3fa1f-eee4-4615-8048-f38144953fb1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:28.494625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-81b3fa1f-eee4-4615-8048-f38144953fb1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:28.495409 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-81b3fa1f-eee4-4615-8048-f38144953fb1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:28.495843 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-81b3fa1f-eee4-4615-8048-f38144953fb1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:28.623112 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-81b3fa1f-eee4-4615-8048-f38144953fb1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:28.630940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-81b3fa1f-eee4-4615-8048-f38144953fb1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.148408 May 19 14:03:28.631512 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 518/1022] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:28 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:29.215885 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e3b2e111-3f86-4152-9451-f5f3cc608313 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:29.216496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e3b2e111-3f86-4152-9451-f5f3cc608313 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:29.223071 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3b2e111-3f86-4152-9451-f5f3cc608313 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:29.223529 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3b2e111-3f86-4152-9451-f5f3cc608313 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:29.224289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3b2e111-3f86-4152-9451-f5f3cc608313 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:29.224727 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3b2e111-3f86-4152-9451-f5f3cc608313 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:29.361524 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e3b2e111-3f86-4152-9451-f5f3cc608313 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:29.369425 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e3b2e111-3f86-4152-9451-f5f3cc608313 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.157359 May 19 14:03:29.369986 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 505/1023] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:29 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:29.649092 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1c763dbb-4725-40e0-acd1-031500db6416 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:29.650385 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1c763dbb-4725-40e0-acd1-031500db6416 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:29.657711 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1c763dbb-4725-40e0-acd1-031500db6416 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:29.658163 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1c763dbb-4725-40e0-acd1-031500db6416 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:29.658961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1c763dbb-4725-40e0-acd1-031500db6416 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:29.659406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1c763dbb-4725-40e0-acd1-031500db6416 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:29.792878 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1c763dbb-4725-40e0-acd1-031500db6416 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:29.801183 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1c763dbb-4725-40e0-acd1-031500db6416 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.155950 May 19 14:03:29.801771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 519/1024] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:29 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:29.816045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-49bdbde3-c72d-430d-8c58-5031e0533617 req-d949939c-824d-419a-8112-f9a7011a5ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ef2420-d67d-4a41-9fe6-9d19390222f7", "name": "network-vif-plugged", "status": "completed", "tag": "6a160eb6-ce50-409b-a90b-42d195382f7b"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:29.824663 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-49bdbde3-c72d-430d-8c58-5031e0533617 req-d949939c-824d-419a-8112-f9a7011a5ca8 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:29.825108 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-49bdbde3-c72d-430d-8c58-5031e0533617 req-d949939c-824d-419a-8112-f9a7011a5ca8 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:29.836416 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-49bdbde3-c72d-430d-8c58-5031e0533617 req-d949939c-824d-419a-8112-f9a7011a5ca8 service nova] Creating event network-vif-plugged:6a160eb6-ce50-409b-a90b-42d195382f7b for instance d8ef2420-d67d-4a41-9fe6-9d19390222f7 on hv-cinder-78481 May 19 14:03:29.841378 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-49bdbde3-c72d-430d-8c58-5031e0533617 req-d949939c-824d-419a-8112-f9a7011a5ca8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029177 May 19 14:03:29.841984 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 506/1025] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:30.183895 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-18f3b1e0-3014-4a86-aec3-0295b3005208 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:30.184392 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-18f3b1e0-3014-4a86-aec3-0295b3005208 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:30.190586 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-18f3b1e0-3014-4a86-aec3-0295b3005208 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:30.191066 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-18f3b1e0-3014-4a86-aec3-0295b3005208 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:30.191822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-18f3b1e0-3014-4a86-aec3-0295b3005208 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:30.192256 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-18f3b1e0-3014-4a86-aec3-0295b3005208 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:30.271673 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-18f3b1e0-3014-4a86-aec3-0295b3005208 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lazy-loading 'services' on Instance uuid 2fe8d4a0-f978-42a1-873f-a34bba7deb96 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:03:30.342007 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-18f3b1e0-3014-4a86-aec3-0295b3005208 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96/os-volume_attachments/28dc7cf5-2e9c-428e-b130-97862490072c" status: 202 len: 0 microversion: 2.1 time: 0.161830 May 19 14:03:30.342586 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 520/1026] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 14:03:30 2022] DELETE /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96/os-volume_attachments/28dc7cf5-2e9c-428e-b130-97862490072c => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:03:30.388471 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9dd0d9ad-803f-4fe4-9074-a2e9ab7e6d6a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:30.389723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9dd0d9ad-803f-4fe4-9074-a2e9ab7e6d6a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:30.397380 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9dd0d9ad-803f-4fe4-9074-a2e9ab7e6d6a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:30.398295 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9dd0d9ad-803f-4fe4-9074-a2e9ab7e6d6a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:30.399362 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9dd0d9ad-803f-4fe4-9074-a2e9ab7e6d6a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:30.399968 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9dd0d9ad-803f-4fe4-9074-a2e9ab7e6d6a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:30.528586 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9dd0d9ad-803f-4fe4-9074-a2e9ab7e6d6a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:30.536092 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9dd0d9ad-803f-4fe4-9074-a2e9ab7e6d6a tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1314 microversion: 2.1 time: 0.153077 May 19 14:03:30.536664 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 507/1027] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:30 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:30.819102 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c5d8c66e-83a4-4861-b289-0ca6ad022ca1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:30.819799 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c5d8c66e-83a4-4861-b289-0ca6ad022ca1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:30.825900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5d8c66e-83a4-4861-b289-0ca6ad022ca1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:30.826357 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5d8c66e-83a4-4861-b289-0ca6ad022ca1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:30.827325 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5d8c66e-83a4-4861-b289-0ca6ad022ca1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:30.827616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c5d8c66e-83a4-4861-b289-0ca6ad022ca1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:30.958640 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c5d8c66e-83a4-4861-b289-0ca6ad022ca1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:30.966083 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c5d8c66e-83a4-4861-b289-0ca6ad022ca1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.151674 May 19 14:03:30.966640 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 521/1028] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:30 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:31.552672 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e71c1904-6dd0-425d-8498-ff1de2fe11e5 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:31.553289 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e71c1904-6dd0-425d-8498-ff1de2fe11e5 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:31.559800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e71c1904-6dd0-425d-8498-ff1de2fe11e5 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:31.560247 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e71c1904-6dd0-425d-8498-ff1de2fe11e5 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:31.561023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e71c1904-6dd0-425d-8498-ff1de2fe11e5 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:31.561460 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e71c1904-6dd0-425d-8498-ff1de2fe11e5 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:31.688440 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e71c1904-6dd0-425d-8498-ff1de2fe11e5 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:31.695893 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e71c1904-6dd0-425d-8498-ff1de2fe11e5 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1464 microversion: 2.1 time: 0.147121 May 19 14:03:31.696450 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 508/1029] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:31 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:31.735343 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d3aab65a-d340-4b6b-89ad-a8c104bf602d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:31.735838 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d3aab65a-d340-4b6b-89ad-a8c104bf602d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:31.742513 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d3aab65a-d340-4b6b-89ad-a8c104bf602d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:31.742995 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d3aab65a-d340-4b6b-89ad-a8c104bf602d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:31.743785 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d3aab65a-d340-4b6b-89ad-a8c104bf602d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:31.744220 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d3aab65a-d340-4b6b-89ad-a8c104bf602d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:31.772428 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d3aab65a-d340-4b6b-89ad-a8c104bf602d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Going to try to terminate instance {{(pid=123751) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:03:31.834512 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:31.852445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d3aab65a-d340-4b6b-89ad-a8c104bf602d tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 204 len: 0 microversion: 2.1 time: 0.120874 May 19 14:03:31.856450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 522/1030] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:03:31 2022] DELETE /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:03:31.861841 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f17fed4d-18d9-479e-bb71-486906b20186 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:31.862461 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f17fed4d-18d9-479e-bb71-486906b20186 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:31.868383 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f17fed4d-18d9-479e-bb71-486906b20186 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:31.868837 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f17fed4d-18d9-479e-bb71-486906b20186 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:31.869595 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f17fed4d-18d9-479e-bb71-486906b20186 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:31.870027 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f17fed4d-18d9-479e-bb71-486906b20186 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:31.983297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3e4d9f14-579a-4a4f-96be-8b47c0594d3e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:31.984141 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3e4d9f14-579a-4a4f-96be-8b47c0594d3e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:31.990092 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3e4d9f14-579a-4a4f-96be-8b47c0594d3e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:31.990537 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3e4d9f14-579a-4a4f-96be-8b47c0594d3e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:31.991320 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3e4d9f14-579a-4a4f-96be-8b47c0594d3e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:31.991756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3e4d9f14-579a-4a4f-96be-8b47c0594d3e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:31.998549 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f17fed4d-18d9-479e-bb71-486906b20186 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:32.006478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f17fed4d-18d9-479e-bb71-486906b20186 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1470 microversion: 2.1 time: 0.148796 May 19 14:03:32.007531 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 509/1031] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:31 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:32.126091 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3e4d9f14-579a-4a4f-96be-8b47c0594d3e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:32.133934 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3e4d9f14-579a-4a4f-96be-8b47c0594d3e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.154785 May 19 14:03:32.134489 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 523/1032] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:31 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:33.024361 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3fdc0730-006d-44c5-a0ac-a2063b00c598 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:33.024992 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3fdc0730-006d-44c5-a0ac-a2063b00c598 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:33.031528 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3fdc0730-006d-44c5-a0ac-a2063b00c598 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:33.031980 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3fdc0730-006d-44c5-a0ac-a2063b00c598 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:33.032752 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3fdc0730-006d-44c5-a0ac-a2063b00c598 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:33.033192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3fdc0730-006d-44c5-a0ac-a2063b00c598 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:33.151434 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-40c156b1-7cf1-4bfb-a500-23fc5eae366d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:33.152054 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-40c156b1-7cf1-4bfb-a500-23fc5eae366d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:33.158823 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40c156b1-7cf1-4bfb-a500-23fc5eae366d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:33.159302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40c156b1-7cf1-4bfb-a500-23fc5eae366d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:33.160071 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40c156b1-7cf1-4bfb-a500-23fc5eae366d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:33.160505 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-40c156b1-7cf1-4bfb-a500-23fc5eae366d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:33.161489 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3fdc0730-006d-44c5-a0ac-a2063b00c598 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:33.169176 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3fdc0730-006d-44c5-a0ac-a2063b00c598 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1470 microversion: 2.1 time: 0.148652 May 19 14:03:33.169745 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 510/1033] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:33 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:33.294498 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-40c156b1-7cf1-4bfb-a500-23fc5eae366d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:33.302259 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-40c156b1-7cf1-4bfb-a500-23fc5eae366d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.154791 May 19 14:03:33.302822 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 524/1034] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:33 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:03:34.187750 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6534ae70-528c-4559-9416-cf9a21a0a07e tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:34.188384 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6534ae70-528c-4559-9416-cf9a21a0a07e tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:34.194844 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6534ae70-528c-4559-9416-cf9a21a0a07e tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:34.195315 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6534ae70-528c-4559-9416-cf9a21a0a07e tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:34.196072 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6534ae70-528c-4559-9416-cf9a21a0a07e tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:34.196504 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6534ae70-528c-4559-9416-cf9a21a0a07e tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:34.318851 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-242acd47-52af-4bd9-b54d-a2826ad6fa98 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:34.319602 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-242acd47-52af-4bd9-b54d-a2826ad6fa98 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:34.322982 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6534ae70-528c-4559-9416-cf9a21a0a07e tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:34.326165 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-242acd47-52af-4bd9-b54d-a2826ad6fa98 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:34.326690 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-242acd47-52af-4bd9-b54d-a2826ad6fa98 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:34.327624 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-242acd47-52af-4bd9-b54d-a2826ad6fa98 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:34.328134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-242acd47-52af-4bd9-b54d-a2826ad6fa98 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:34.331076 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6534ae70-528c-4559-9416-cf9a21a0a07e tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1470 microversion: 2.1 time: 0.147542 May 19 14:03:34.331841 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 511/1035] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:34 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:34.548763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-242acd47-52af-4bd9-b54d-a2826ad6fa98 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:34.556508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-242acd47-52af-4bd9-b54d-a2826ad6fa98 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.241469 May 19 14:03:34.557161 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 525/1036] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:34 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:03:35.129817 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-0984ac06-cfc6-411c-9502-2c497dc11294 req-77be8dc9-507b-4ded-ae39-99e8935a37f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8ef2420-d67d-4a41-9fe6-9d19390222f7", "name": "network-vif-deleted", "tag": "6a160eb6-ce50-409b-a90b-42d195382f7b"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:35.141017 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-0984ac06-cfc6-411c-9502-2c497dc11294 req-77be8dc9-507b-4ded-ae39-99e8935a37f5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.141508 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-0984ac06-cfc6-411c-9502-2c497dc11294 req-77be8dc9-507b-4ded-ae39-99e8935a37f5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.154000 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-0984ac06-cfc6-411c-9502-2c497dc11294 req-77be8dc9-507b-4ded-ae39-99e8935a37f5 service nova] Creating event network-vif-deleted:6a160eb6-ce50-409b-a90b-42d195382f7b for instance d8ef2420-d67d-4a41-9fe6-9d19390222f7 on hv-cinder-78481 May 19 14:03:35.160410 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-0984ac06-cfc6-411c-9502-2c497dc11294 req-77be8dc9-507b-4ded-ae39-99e8935a37f5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034579 May 19 14:03:35.161141 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 512/1037] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:35.348406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:35.348947 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:35.355403 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.355851 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.356638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.357070 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.387394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.387841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.388288 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lazy-loading 'fault' on Instance uuid d8ef2420-d67d-4a41-9fe6-9d19390222f7 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:03:35.390599 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:35.435576 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5db2bab7613543bbab2db936926966b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f658c67bd7245eaaadf3f969fc562b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:35.442940 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-579222f7-9d3d-4e75-b466-fca8ba7626e4 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 200 len: 1304 microversion: 2.1 time: 0.098489 May 19 14:03:35.443518 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 526/1038] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:35 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:35.574163 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-26baf5ca-3e52-4d3d-914b-1d6f3d448054 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:35.574893 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-26baf5ca-3e52-4d3d-914b-1d6f3d448054 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:35.581839 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-26baf5ca-3e52-4d3d-914b-1d6f3d448054 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.582286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-26baf5ca-3e52-4d3d-914b-1d6f3d448054 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.583126 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-26baf5ca-3e52-4d3d-914b-1d6f3d448054 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.583705 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-26baf5ca-3e52-4d3d-914b-1d6f3d448054 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.702667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a07dede8-b313-4ac1-9d8f-d4c56dd6caf0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:35.703345 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a07dede8-b313-4ac1-9d8f-d4c56dd6caf0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:35.711147 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a07dede8-b313-4ac1-9d8f-d4c56dd6caf0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.711708 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a07dede8-b313-4ac1-9d8f-d4c56dd6caf0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.712547 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a07dede8-b313-4ac1-9d8f-d4c56dd6caf0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.713080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a07dede8-b313-4ac1-9d8f-d4c56dd6caf0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.736028 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-26baf5ca-3e52-4d3d-914b-1d6f3d448054 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:35.741493 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a07dede8-b313-4ac1-9d8f-d4c56dd6caf0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Going to try to terminate instance {{(pid=123751) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:03:35.745349 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-26baf5ca-3e52-4d3d-914b-1d6f3d448054 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.175109 May 19 14:03:35.746294 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 513/1039] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:35 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:35.825728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a07dede8-b313-4ac1-9d8f-d4c56dd6caf0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "DELETE /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 204 len: 0 microversion: 2.1 time: 0.127525 May 19 14:03:35.830394 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 527/1040] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:03:35 2022] DELETE /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:03:35.836486 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-06de5a05-84b3-4cbc-be70-71d2e7a386a0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:35.837984 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-06de5a05-84b3-4cbc-be70-71d2e7a386a0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:35.845271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-06de5a05-84b3-4cbc-be70-71d2e7a386a0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.845730 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-06de5a05-84b3-4cbc-be70-71d2e7a386a0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.846607 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-06de5a05-84b3-4cbc-be70-71d2e7a386a0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:35.847323 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-06de5a05-84b3-4cbc-be70-71d2e7a386a0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:35.851669 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=100 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:03:35.981125 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-06de5a05-84b3-4cbc-be70-71d2e7a386a0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:35.988645 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-06de5a05-84b3-4cbc-be70-71d2e7a386a0 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1513 microversion: 2.1 time: 0.156970 May 19 14:03:35.989207 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 514/1041] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:35 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:03:36.461250 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:36.461954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] [instance: d8ef2420-d67d-4a41-9fe6-9d19390222f7] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:36.468453 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:36.468910 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:36.469788 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:36.470422 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:36.484241 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] HTTP exception thrown: Instance d8ef2420-d67d-4a41-9fe6-9d19390222f7 could not be found. May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Request method failure captured: May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 HTTP/1.1 May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihk4hQKa6XG9OXYRYRq6Kd_egV2Mnkv3l3raa7ccVSRZQGpKYYvMsLpjTNrDIgkFfrq5Av1M7KBY1V6LcpukVod7F5Kznxvwya2Z6ye4KtHSKbFbErP0v92MTyr-qNSYr4PhruOQKGhivrqY_VusFP-G1iWyCIk2fC3u5puzc1V-9_qo May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 8f658c67bd7245eaaadf3f969fc562b5 May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesNegativeTest-2067606696 May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:03:36.485917 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8f658c67bd7245eaaadf3f969fc562b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f658c67bd7245eaaadf3f969fc562b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8f658c67bd7245eaaadf3f969fc562b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8f658c67bd7245eaaadf3f969fc562b5"}]}] May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesNegativeTest-2067606696 May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 8f658c67bd7245eaaadf3f969fc562b5 May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesNegativeTest-2067606696 May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesNegativeTest-2067606696-project May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 5db2bab7613543bbab2db936926966b3 May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesNegativeTest-2067606696-project May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance d8ef2420-d67d-4a41-9fe6-9d19390222f7 could not be found. May 19 14:03:36.489153 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': 'd8ef2420-d67d-4a41-9fe6-9d19390222f7'} May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8ef2420-d67d-4a41-9fe6-9d19390222f7 could not be found. May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:03:36.491098 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8ef2420-d67d-4a41-9fe6-9d19390222f7 could not be found. May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8ef2420-d67d-4a41-9fe6-9d19390222f7 could not be found. May 19 14:03:36.493907 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:36.495310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] Returning 404 to user: Instance d8ef2420-d67d-4a41-9fe6-9d19390222f7 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:03:36.495310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-2ddc8a63-c045-4ad5-8b59-acdc0595f559 tempest-VolumesNegativeTest-2067606696 tempest-VolumesNegativeTest-2067606696-project] 10.222.0.52 "GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7" status: 404 len: 111 microversion: 2.1 time: 0.030350 May 19 14:03:36.495310 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 528/1042] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:36 2022] GET /compute/v2.1/servers/d8ef2420-d67d-4a41-9fe6-9d19390222f7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:03:36.762901 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e0c6366f-d18c-4b45-8b76-f1454abf9d72 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:36.763799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e0c6366f-d18c-4b45-8b76-f1454abf9d72 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:36.770391 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e0c6366f-d18c-4b45-8b76-f1454abf9d72 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:36.770834 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e0c6366f-d18c-4b45-8b76-f1454abf9d72 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:36.771624 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e0c6366f-d18c-4b45-8b76-f1454abf9d72 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:36.772056 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e0c6366f-d18c-4b45-8b76-f1454abf9d72 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:36.912054 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e0c6366f-d18c-4b45-8b76-f1454abf9d72 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:36.920471 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e0c6366f-d18c-4b45-8b76-f1454abf9d72 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.161421 May 19 14:03:36.921103 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 515/1043] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:36 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:37.006126 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9d867c7f-e3af-4c98-91ac-c620463401d9 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:37.006741 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9d867c7f-e3af-4c98-91ac-c620463401d9 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:37.013202 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9d867c7f-e3af-4c98-91ac-c620463401d9 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:37.013667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9d867c7f-e3af-4c98-91ac-c620463401d9 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:37.014946 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9d867c7f-e3af-4c98-91ac-c620463401d9 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:37.015397 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9d867c7f-e3af-4c98-91ac-c620463401d9 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:37.157832 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9d867c7f-e3af-4c98-91ac-c620463401d9 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:37.166494 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9d867c7f-e3af-4c98-91ac-c620463401d9 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1513 microversion: 2.1 time: 0.163954 May 19 14:03:37.167115 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 529/1044] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:37 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:37.840958 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-88c72a45-d80b-49bf-9388-ea2df0d6b9ab req-b8ed21de-f65f-4d8d-aa7b-b15e06e11aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfea4879-afb7-4f52-99f6-c666d214000d", "name": "network-vif-plugged", "status": "completed", "tag": "2888e720-a274-4cb2-91e2-5264abb78eda"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:37.851432 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-88c72a45-d80b-49bf-9388-ea2df0d6b9ab req-b8ed21de-f65f-4d8d-aa7b-b15e06e11aee service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:37.852045 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-88c72a45-d80b-49bf-9388-ea2df0d6b9ab req-b8ed21de-f65f-4d8d-aa7b-b15e06e11aee service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:37.868944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-88c72a45-d80b-49bf-9388-ea2df0d6b9ab req-b8ed21de-f65f-4d8d-aa7b-b15e06e11aee service nova] Creating event network-vif-plugged:2888e720-a274-4cb2-91e2-5264abb78eda for instance bfea4879-afb7-4f52-99f6-c666d214000d on hv-cinder-78481 May 19 14:03:37.874278 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-88c72a45-d80b-49bf-9388-ea2df0d6b9ab req-b8ed21de-f65f-4d8d-aa7b-b15e06e11aee service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037387 May 19 14:03:37.875854 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 516/1045] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:37.938512 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c28be5c2-2da8-40fc-a0df-9b4a34c0e2db tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:37.940134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c28be5c2-2da8-40fc-a0df-9b4a34c0e2db tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:37.947975 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c28be5c2-2da8-40fc-a0df-9b4a34c0e2db tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:37.948440 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c28be5c2-2da8-40fc-a0df-9b4a34c0e2db tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:37.949233 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c28be5c2-2da8-40fc-a0df-9b4a34c0e2db tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:37.949663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c28be5c2-2da8-40fc-a0df-9b4a34c0e2db tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:38.165260 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c28be5c2-2da8-40fc-a0df-9b4a34c0e2db tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:38.175140 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c28be5c2-2da8-40fc-a0df-9b4a34c0e2db tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.241169 May 19 14:03:38.175794 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 530/1046] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:37 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:38.193332 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ab079cff-95bc-4602-903a-ddbc15e57991 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:38.194628 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ab079cff-95bc-4602-903a-ddbc15e57991 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:38.214560 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab079cff-95bc-4602-903a-ddbc15e57991 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:38.215254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab079cff-95bc-4602-903a-ddbc15e57991 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:38.217381 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab079cff-95bc-4602-903a-ddbc15e57991 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:38.217919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab079cff-95bc-4602-903a-ddbc15e57991 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:38.304353 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ab079cff-95bc-4602-903a-ddbc15e57991 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:38.312627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ab079cff-95bc-4602-903a-ddbc15e57991 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1471 microversion: 2.1 time: 0.125098 May 19 14:03:38.314124 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 517/1047] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:38 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1471 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:38.368756 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-79d4a525-7802-4348-b9df-4039f4846274 req-b053e456-66f0-4ea4-8f02-4dc924f8c8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fe8d4a0-f978-42a1-873f-a34bba7deb96", "name": "network-vif-deleted", "tag": "e10b7062-e698-490e-89b8-da759d33b5a4"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:38.377861 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-79d4a525-7802-4348-b9df-4039f4846274 req-b053e456-66f0-4ea4-8f02-4dc924f8c8e1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:38.378300 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-79d4a525-7802-4348-b9df-4039f4846274 req-b053e456-66f0-4ea4-8f02-4dc924f8c8e1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:38.390203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-79d4a525-7802-4348-b9df-4039f4846274 req-b053e456-66f0-4ea4-8f02-4dc924f8c8e1 service nova] Creating event network-vif-deleted:e10b7062-e698-490e-89b8-da759d33b5a4 for instance 2fe8d4a0-f978-42a1-873f-a34bba7deb96 on hv-cinder-78481 May 19 14:03:38.395402 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-79d4a525-7802-4348-b9df-4039f4846274 req-b053e456-66f0-4ea4-8f02-4dc924f8c8e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030250 May 19 14:03:38.395992 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 531/1048] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:03:39.193910 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-57408e9f-abb1-4015-b48b-fd5391f97c02 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:39.195288 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-57408e9f-abb1-4015-b48b-fd5391f97c02 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:39.201826 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57408e9f-abb1-4015-b48b-fd5391f97c02 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:39.202281 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57408e9f-abb1-4015-b48b-fd5391f97c02 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:39.203094 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57408e9f-abb1-4015-b48b-fd5391f97c02 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:39.203515 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57408e9f-abb1-4015-b48b-fd5391f97c02 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:39.330415 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:39.331050 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:39.337256 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-57408e9f-abb1-4015-b48b-fd5391f97c02 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:39.338021 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:39.338474 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:39.339302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:39.339891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:39.345224 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-57408e9f-abb1-4015-b48b-fd5391f97c02 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1263 microversion: 2.1 time: 0.154658 May 19 14:03:39.345951 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 518/1049] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:39 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:39.373477 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:39.373948 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:39.374426 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.objects.instance [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lazy-loading 'fault' on Instance uuid 2fe8d4a0-f978-42a1-873f-a34bba7deb96 {{(pid=123751) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:03:39.420389 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12d3af57f5e34f798336d353a111cefd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68358e9d695445490f8209d832a1c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:39.431214 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-d6311d82-9547-4d42-9028-d48e72e55d97 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 200 len: 1308 microversion: 2.1 time: 0.105179 May 19 14:03:39.432551 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 532/1050] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:39 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:03:40.362700 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6398ed27-91cf-4a34-ad61-930441d4937a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:40.363414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6398ed27-91cf-4a34-ad61-930441d4937a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:40.370020 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6398ed27-91cf-4a34-ad61-930441d4937a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:40.370479 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6398ed27-91cf-4a34-ad61-930441d4937a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:40.371281 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6398ed27-91cf-4a34-ad61-930441d4937a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:40.371747 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6398ed27-91cf-4a34-ad61-930441d4937a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:40.447993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:40.448611 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] [instance: 2fe8d4a0-f978-42a1-873f-a34bba7deb96] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:40.461899 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:40.462352 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:40.463333 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:40.463930 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:40.478294 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] HTTP exception thrown: Instance 2fe8d4a0-f978-42a1-873f-a34bba7deb96 could not be found. May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Request method failure captured: May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 HTTP/1.1 May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihk3DDKFAhikKo23wF77rANHa_aLQXXNgzqfBVL-B3RpFKpGGifkP0Z8iFAjhVYug_gjH6wb8MjGlm-BeCgytl_loqQPQqZgBlfi1Iwf3EDAbgQ1PIfiuKMhXgw_p1Ca03_Eqi716QkRYHzaSH9cX4ucGOT4VZSB59lPZXviB7w23M_k May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: f68358e9d695445490f8209d832a1c13 May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1128149502 May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:03:40.479980 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_f68358e9d695445490f8209d832a1c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f68358e9d695445490f8209d832a1c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/f68358e9d695445490f8209d832a1c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/f68358e9d695445490f8209d832a1c13"}]}] May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-VolumesSnapshotTestJSON-1128149502 May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: f68358e9d695445490f8209d832a1c13 May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1128149502 May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-VolumesSnapshotTestJSON-1128149502-project May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: 12d3af57f5e34f798336d353a111cefd May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-VolumesSnapshotTestJSON-1128149502-project May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 2fe8d4a0-f978-42a1-873f-a34bba7deb96 could not be found. May 19 14:03:40.481625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '2fe8d4a0-f978-42a1-873f-a34bba7deb96'} May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fe8d4a0-f978-42a1-873f-a34bba7deb96 could not be found. May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:03:40.482548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fe8d4a0-f978-42a1-873f-a34bba7deb96 could not be found. May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fe8d4a0-f978-42a1-873f-a34bba7deb96 could not be found. May 19 14:03:40.484107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:03:40.486845 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] Returning 404 to user: Instance 2fe8d4a0-f978-42a1-873f-a34bba7deb96 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:03:40.486845 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a590900c-01db-4c48-9481-0623c2cc93b1 tempest-VolumesSnapshotTestJSON-1128149502 tempest-VolumesSnapshotTestJSON-1128149502-project] 10.222.0.52 "GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96" status: 404 len: 111 microversion: 2.1 time: 0.037272 May 19 14:03:40.486845 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 533/1051] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:40 2022] GET /compute/v2.1/servers/2fe8d4a0-f978-42a1-873f-a34bba7deb96 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 14:03:40.522430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6398ed27-91cf-4a34-ad61-930441d4937a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:40.530172 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6398ed27-91cf-4a34-ad61-930441d4937a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1450 microversion: 2.1 time: 0.171684 May 19 14:03:40.535724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 519/1052] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:40 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1450 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:40.546092 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-4b4b1bf8-d553-4e89-b635-1f9e0ec53eaf tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:03:40.547028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-4b4b1bf8-d553-4e89-b635-1f9e0ec53eaf tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:03:40.556055 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4b4b1bf8-d553-4e89-b635-1f9e0ec53eaf tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:40.556909 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4b4b1bf8-d553-4e89-b635-1f9e0ec53eaf tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:40.558633 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4b4b1bf8-d553-4e89-b635-1f9e0ec53eaf tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:40.559118 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-4b4b1bf8-d553-4e89-b635-1f9e0ec53eaf tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:40.740927 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-4b4b1bf8-d553-4e89-b635-1f9e0ec53eaf tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:03:40.748414 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-4b4b1bf8-d553-4e89-b635-1f9e0ec53eaf tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1450 microversion: 2.1 time: 0.206173 May 19 14:03:40.748984 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 534/1053] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:03:40 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1450 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:03:42.530612 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-13c2dcf0-3b3a-4847-852b-5f4f35b747ca req-a23ba16e-9b6c-4b2d-85e0-4cb75b9e7751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfea4879-afb7-4f52-99f6-c666d214000d", "tag": "2888e720-a274-4cb2-91e2-5264abb78eda"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:03:42.539538 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-13c2dcf0-3b3a-4847-852b-5f4f35b747ca req-a23ba16e-9b6c-4b2d-85e0-4cb75b9e7751 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:03:42.539976 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-13c2dcf0-3b3a-4847-852b-5f4f35b747ca req-a23ba16e-9b6c-4b2d-85e0-4cb75b9e7751 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:03:42.551475 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-13c2dcf0-3b3a-4847-852b-5f4f35b747ca req-a23ba16e-9b6c-4b2d-85e0-4cb75b9e7751 service nova] Creating event network-changed:2888e720-a274-4cb2-91e2-5264abb78eda for instance bfea4879-afb7-4f52-99f6-c666d214000d on hv-cinder-78481 May 19 14:03:42.556264 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-13c2dcf0-3b3a-4847-852b-5f4f35b747ca req-a23ba16e-9b6c-4b2d-85e0-4cb75b9e7751 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029387 May 19 14:03:42.556854 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 520/1054] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:02.646709 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-fd1fdc46-257a-43ca-87de-6873208cad3b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:02.647405 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-fd1fdc46-257a-43ca-87de-6873208cad3b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:02.650661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:04:02.651347 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:04:02.657605 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fd1fdc46-257a-43ca-87de-6873208cad3b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:02.658127 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fd1fdc46-257a-43ca-87de-6873208cad3b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:02.658853 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fd1fdc46-257a-43ca-87de-6873208cad3b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:02.659495 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-fd1fdc46-257a-43ca-87de-6873208cad3b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:02.688613 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-fd1fdc46-257a-43ca-87de-6873208cad3b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/ips" status: 200 len: 145 microversion: 2.1 time: 0.045863 May 19 14:04:02.689191 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 535/1055] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 14:04:02 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:04.018516 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=44 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:04:04.019286 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=32 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:04:04.023860 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0fb3dfd8-83b1-4159-b6db-a3c072ef5ebf tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1f8f178-645b-483a-b439-09558f301b69"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:04:04.024997 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0fb3dfd8-83b1-4159-b6db-a3c072ef5ebf tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:04.031933 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0fb3dfd8-83b1-4159-b6db-a3c072ef5ebf tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:04.032390 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0fb3dfd8-83b1-4159-b6db-a3c072ef5ebf tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:04.033670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0fb3dfd8-83b1-4159-b6db-a3c072ef5ebf tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:04.034552 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0fb3dfd8-83b1-4159-b6db-a3c072ef5ebf tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:04.286302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0fb3dfd8-83b1-4159-b6db-a3c072ef5ebf tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269537 May 19 14:04:04.286961 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 521/1056] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 14:04:04 2022] POST /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:11.773868 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-63852998-2294-4dbe-b453-308f453c6440 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:11.774790 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-63852998-2294-4dbe-b453-308f453c6440 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:11.781242 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63852998-2294-4dbe-b453-308f453c6440 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:11.781689 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63852998-2294-4dbe-b453-308f453c6440 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:11.782450 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63852998-2294-4dbe-b453-308f453c6440 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:11.782903 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-63852998-2294-4dbe-b453-308f453c6440 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:11.812663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-63852998-2294-4dbe-b453-308f453c6440 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042747 May 19 14:04:11.813467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 536/1057] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 14:04:11 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:11.824335 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-19905478-4841-4c52-ba25-80ec5410edfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:11.824929 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-19905478-4841-4c52-ba25-80ec5410edfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:11.831180 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19905478-4841-4c52-ba25-80ec5410edfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:11.831651 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19905478-4841-4c52-ba25-80ec5410edfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:11.832421 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19905478-4841-4c52-ba25-80ec5410edfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:11.832862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19905478-4841-4c52-ba25-80ec5410edfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:11.860815 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-19905478-4841-4c52-ba25-80ec5410edfd tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/a1f8f178-645b-483a-b439-09558f301b69" status: 200 len: 194 microversion: 2.1 time: 0.041286 May 19 14:04:11.861383 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 522/1058] 10.222.0.52 () {58 vars in 1412 bytes} [Thu May 19 14:04:11 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/a1f8f178-645b-483a-b439-09558f301b69 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:13.171658 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-83c6884b-8b7e-4fd4-b31d-228ebfe84c19 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d7f1bb1-be65-4983-aef7-33b3277ad6bb"}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:04:13.172718 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-83c6884b-8b7e-4fd4-b31d-228ebfe84c19 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:13.178935 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-83c6884b-8b7e-4fd4-b31d-228ebfe84c19 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:13.179400 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-83c6884b-8b7e-4fd4-b31d-228ebfe84c19 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:13.180169 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-83c6884b-8b7e-4fd4-b31d-228ebfe84c19 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:13.180610 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-83c6884b-8b7e-4fd4-b31d-228ebfe84c19 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:13.443556 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-83c6884b-8b7e-4fd4-b31d-228ebfe84c19 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "POST /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275804 May 19 14:04:13.444363 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 537/1059] 10.222.0.52 () {60 vars in 1322 bytes} [Thu May 19 14:04:13 2022] POST /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:20.937424 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-28383f81-7cd1-4df7-83a6-e6c34666403f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:20.938403 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-28383f81-7cd1-4df7-83a6-e6c34666403f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:20.945234 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-28383f81-7cd1-4df7-83a6-e6c34666403f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:20.945714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-28383f81-7cd1-4df7-83a6-e6c34666403f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:20.946478 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-28383f81-7cd1-4df7-83a6-e6c34666403f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:20.946942 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-28383f81-7cd1-4df7-83a6-e6c34666403f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:20.976097 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-28383f81-7cd1-4df7-83a6-e6c34666403f tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042648 May 19 14:04:20.976641 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 523/1060] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 14:04:20 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:21.120300 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e645d2f8-2b16-4687-9cda-844c2a8ce650 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:21.120878 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e645d2f8-2b16-4687-9cda-844c2a8ce650 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:21.127209 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e645d2f8-2b16-4687-9cda-844c2a8ce650 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:21.127663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e645d2f8-2b16-4687-9cda-844c2a8ce650 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:21.128944 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e645d2f8-2b16-4687-9cda-844c2a8ce650 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:21.129393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e645d2f8-2b16-4687-9cda-844c2a8ce650 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:21.157818 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e645d2f8-2b16-4687-9cda-844c2a8ce650 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/a1f8f178-645b-483a-b439-09558f301b69" status: 200 len: 194 microversion: 2.1 time: 0.042331 May 19 14:04:21.158377 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 538/1061] 10.222.0.52 () {58 vars in 1412 bytes} [Thu May 19 14:04:21 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/a1f8f178-645b-483a-b439-09558f301b69 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:21.167867 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0a023654-9fc3-490b-ba5a-5a595048268c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:21.168411 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0a023654-9fc3-490b-ba5a-5a595048268c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:21.174272 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a023654-9fc3-490b-ba5a-5a595048268c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:21.174723 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a023654-9fc3-490b-ba5a-5a595048268c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:21.175630 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a023654-9fc3-490b-ba5a-5a595048268c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:21.175969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a023654-9fc3-490b-ba5a-5a595048268c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:21.452213 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-0a023654-9fc3-490b-ba5a-5a595048268c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lazy-loading 'services' on Instance uuid a65d85b2-643f-4802-bef7-c9f9891f7edd {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:04:21.530339 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0a023654-9fc3-490b-ba5a-5a595048268c tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/a1f8f178-645b-483a-b439-09558f301b69" status: 202 len: 0 microversion: 2.1 time: 0.366129 May 19 14:04:21.534908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 524/1062] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 14:04:21 2022] DELETE /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/a1f8f178-645b-483a-b439-09558f301b69 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:04:22.653439 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8e553961-af1c-4bda-94e1-bc1ee417c364 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:22.654045 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-8e553961-af1c-4bda-94e1-bc1ee417c364 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:22.660955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8e553961-af1c-4bda-94e1-bc1ee417c364 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:22.661412 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8e553961-af1c-4bda-94e1-bc1ee417c364 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:22.662199 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8e553961-af1c-4bda-94e1-bc1ee417c364 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:22.662648 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-8e553961-af1c-4bda-94e1-bc1ee417c364 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:22.694405 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8e553961-af1c-4bda-94e1-bc1ee417c364 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/2d7f1bb1-be65-4983-aef7-33b3277ad6bb" status: 200 len: 194 microversion: 2.1 time: 0.044811 May 19 14:04:22.695040 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 539/1063] 10.222.0.52 () {58 vars in 1412 bytes} [Thu May 19 14:04:22 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/2d7f1bb1-be65-4983-aef7-33b3277ad6bb => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:22.706036 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dae40dbb-806d-428e-aea4-4e2a824a6078 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:22.707427 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dae40dbb-806d-428e-aea4-4e2a824a6078 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:22.714341 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dae40dbb-806d-428e-aea4-4e2a824a6078 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:22.714637 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dae40dbb-806d-428e-aea4-4e2a824a6078 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:22.715450 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dae40dbb-806d-428e-aea4-4e2a824a6078 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:22.715890 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dae40dbb-806d-428e-aea4-4e2a824a6078 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:22.801503 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-dae40dbb-806d-428e-aea4-4e2a824a6078 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lazy-loading 'services' on Instance uuid a65d85b2-643f-4802-bef7-c9f9891f7edd {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 14:04:22.874995 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dae40dbb-806d-428e-aea4-4e2a824a6078 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/2d7f1bb1-be65-4983-aef7-33b3277ad6bb" status: 202 len: 0 microversion: 2.1 time: 0.173527 May 19 14:04:22.875592 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 525/1064] 10.222.0.52 () {58 vars in 1415 bytes} [Thu May 19 14:04:22 2022] DELETE /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments/2d7f1bb1-be65-4983-aef7-33b3277ad6bb => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:04:24.045633 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-e1810458-81f1-4e70-adc4-7c4fae057d90 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:24.046605 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-e1810458-81f1-4e70-adc4-7c4fae057d90 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:24.053889 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e1810458-81f1-4e70-adc4-7c4fae057d90 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:24.054334 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e1810458-81f1-4e70-adc4-7c4fae057d90 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:24.055138 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e1810458-81f1-4e70-adc4-7c4fae057d90 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:24.055575 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-e1810458-81f1-4e70-adc4-7c4fae057d90 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:24.094025 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-e1810458-81f1-4e70-adc4-7c4fae057d90 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052417 May 19 14:04:24.094574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 540/1065] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 14:04:24 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 14:04:24.201907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f7b8bbe6-dc9e-4b11-ba2a-3d0ae21ec40d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:24.202824 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f7b8bbe6-dc9e-4b11-ba2a-3d0ae21ec40d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:24.209804 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7b8bbe6-dc9e-4b11-ba2a-3d0ae21ec40d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:24.210254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7b8bbe6-dc9e-4b11-ba2a-3d0ae21ec40d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:24.211055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7b8bbe6-dc9e-4b11-ba2a-3d0ae21ec40d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:24.211496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7b8bbe6-dc9e-4b11-ba2a-3d0ae21ec40d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:24.240297 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f7b8bbe6-dc9e-4b11-ba2a-3d0ae21ec40d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043131 May 19 14:04:24.240862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 526/1066] 10.222.0.52 () {58 vars in 1301 bytes} [Thu May 19 14:04:24 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 14:04:24.298133 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-64de0fd7-c657-477d-ae36-90624540765d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:24.298629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-64de0fd7-c657-477d-ae36-90624540765d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:24.305671 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-64de0fd7-c657-477d-ae36-90624540765d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:24.306176 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-64de0fd7-c657-477d-ae36-90624540765d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:24.306966 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-64de0fd7-c657-477d-ae36-90624540765d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:24.307405 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-64de0fd7-c657-477d-ae36-90624540765d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:24.333489 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-64de0fd7-c657-477d-ae36-90624540765d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Going to try to terminate instance {{(pid=123751) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:04:24.415390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-64de0fd7-c657-477d-ae36-90624540765d tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 204 len: 0 microversion: 2.1 time: 0.120560 May 19 14:04:24.416555 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 541/1067] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:04:24 2022] DELETE /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:04:24.426246 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-31920486-bc7f-4028-9c99-820311126b83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:24.426479 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-31920486-bc7f-4028-9c99-820311126b83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:24.432390 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-31920486-bc7f-4028-9c99-820311126b83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:24.432835 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-31920486-bc7f-4028-9c99-820311126b83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:24.433594 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-31920486-bc7f-4028-9c99-820311126b83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:24.434075 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-31920486-bc7f-4028-9c99-820311126b83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:24.575485 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-31920486-bc7f-4028-9c99-820311126b83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:04:24.583214 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-31920486-bc7f-4028-9c99-820311126b83 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1673 microversion: 2.1 time: 0.162347 May 19 14:04:24.583779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 527/1068] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:04:24 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:04:25.601772 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5ea0bdd0-d61b-477a-a07d-4b35a4621aa9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:25.602475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5ea0bdd0-d61b-477a-a07d-4b35a4621aa9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:25.609007 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5ea0bdd0-d61b-477a-a07d-4b35a4621aa9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:25.609539 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5ea0bdd0-d61b-477a-a07d-4b35a4621aa9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:25.610236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5ea0bdd0-d61b-477a-a07d-4b35a4621aa9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:25.610675 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5ea0bdd0-d61b-477a-a07d-4b35a4621aa9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:25.853494 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5ea0bdd0-d61b-477a-a07d-4b35a4621aa9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:04:25.861297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5ea0bdd0-d61b-477a-a07d-4b35a4621aa9 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1673 microversion: 2.1 time: 0.263729 May 19 14:04:25.871815 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 542/1069] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:04:25 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1673 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:04:26.879529 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3306134a-7710-4d43-9f88-445d3c958bae tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:26.880200 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3306134a-7710-4d43-9f88-445d3c958bae tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:26.886837 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3306134a-7710-4d43-9f88-445d3c958bae tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:26.887342 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3306134a-7710-4d43-9f88-445d3c958bae tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:26.888306 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3306134a-7710-4d43-9f88-445d3c958bae tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:26.888670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3306134a-7710-4d43-9f88-445d3c958bae tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:26.995084 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3306134a-7710-4d43-9f88-445d3c958bae tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1b34a915464792b5d3b74956bc49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14dac6dd56c4f93b65ad91673debf71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:04:27.005327 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3306134a-7710-4d43-9f88-445d3c958bae tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 200 len: 1606 microversion: 2.1 time: 0.129833 May 19 14:04:27.006418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 528/1070] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:04:26 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 1606 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:04:27.185955 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-5bab61c2-79b3-42f9-ae7b-f57f2f5036c3 req-e9a92522-77a3-4121-9e97-08c5d504fa10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a65d85b2-643f-4802-bef7-c9f9891f7edd", "name": "network-vif-deleted", "tag": "5d7c81fc-927f-4959-bc8f-48bd05561155"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:04:27.197445 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-5bab61c2-79b3-42f9-ae7b-f57f2f5036c3 req-e9a92522-77a3-4121-9e97-08c5d504fa10 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:27.199383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-5bab61c2-79b3-42f9-ae7b-f57f2f5036c3 req-e9a92522-77a3-4121-9e97-08c5d504fa10 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:27.214661 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-5bab61c2-79b3-42f9-ae7b-f57f2f5036c3 req-e9a92522-77a3-4121-9e97-08c5d504fa10 service nova] Creating event network-vif-deleted:5d7c81fc-927f-4959-bc8f-48bd05561155 for instance a65d85b2-643f-4802-bef7-c9f9891f7edd on hv-cinder-78481 May 19 14:04:27.220906 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-5bab61c2-79b3-42f9-ae7b-f57f2f5036c3 req-e9a92522-77a3-4121-9e97-08c5d504fa10 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038759 May 19 14:04:27.221687 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 543/1071] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:28.023480 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:28.024102 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:28.030494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:28.030982 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:28.031753 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:28.032192 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:28.046216 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] HTTP exception thrown: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Request method failure captured: May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd HTTP/1.1 May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihk1S-tf-0b4m2-9a_IbBNs4f_h-_4iPgz6ZfXcuET3MS3GumBp90VeGvf2ZJeQnmSjbPqxu_XtHjlCK8_Q7XnIZAo13JgfZ3kkc88TByX1HnvvBNZEbLGWWi0nHibVvenY7A_REw9FN4V6m3VL_OOGVWZzyhWtDAn0GuNyVkziyBh-c May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:04:28.047899 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}] May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: ab1b34a915464792b5d3b74956bc49a2 May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:28.049598 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': 'a65d85b2-643f-4802-bef7-c9f9891f7edd'} May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:04:28.051198 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:28.052536 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:28.053733 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Returning 404 to user: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:04:28.053733 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bfa5c9f4-f64a-4364-bd9c-604bbf8c9ea8 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 404 len: 111 microversion: 2.1 time: 0.029771 May 19 14:04:28.053733 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 529/1072] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:04:28 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:04:28.059387 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a5c556a2-e608-4dc3-9032-24bb9e98c5f0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '.version_select at 0x7f5de2543af0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:28.076736 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a5c556a2-e608-4dc3-9032-24bb9e98c5f0 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708554903" status: 202 len: 0 microversion: 2.1 time: 0.021452 May 19 14:04:28.077307 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 544/1073] 10.222.0.52 () {58 vars in 1220 bytes} [Thu May 19 14:04:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1708554903 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:04:30.946963 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:30.947489 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:30.954172 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:30.954621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:30.955418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:30.955857 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:30.969869 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] HTTP exception thrown: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Request method failure captured: May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd HTTP/1.1 May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihk1S-tf-0b4m2-9a_IbBNs4f_h-_4iPgz6ZfXcuET3MS3GumBp90VeGvf2ZJeQnmSjbPqxu_XtHjlCK8_Q7XnIZAo13JgfZ3kkc88TByX1HnvvBNZEbLGWWi0nHibVvenY7A_REw9FN4V6m3VL_OOGVWZzyhWtDAn0GuNyVkziyBh-c May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:04:30.971451 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}] May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: ab1b34a915464792b5d3b74956bc49a2 May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:30.974131 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': 'a65d85b2-643f-4802-bef7-c9f9891f7edd'} May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:04:30.974944 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:30.976168 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:30.978157 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Returning 404 to user: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:04:30.978157 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cdd4b473-3e36-4c8d-9660-8e7e5cad7976 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 404 len: 111 microversion: 2.1 time: 0.030254 May 19 14:04:30.978157 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 530/1074] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:04:30 2022] DELETE /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:04:30.984710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:30.985452 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: a65d85b2-643f-4802-bef7-c9f9891f7edd] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:30.993616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:30.994089 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:30.994938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:30.995390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:31.012231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] HTTP exception thrown: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Request method failure captured: May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd HTTP/1.1 May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihk1S-tf-0b4m2-9a_IbBNs4f_h-_4iPgz6ZfXcuET3MS3GumBp90VeGvf2ZJeQnmSjbPqxu_XtHjlCK8_Q7XnIZAo13JgfZ3kkc88TByX1HnvvBNZEbLGWWi0nHibVvenY7A_REw9FN4V6m3VL_OOGVWZzyhWtDAn0GuNyVkziyBh-c May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:04:31.013928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}] May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: ab1b34a915464792b5d3b74956bc49a2 May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:31.015592 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': 'a65d85b2-643f-4802-bef7-c9f9891f7edd'} May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:04:31.016508 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. May 19 14:04:31.018028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:31.019787 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Returning 404 to user: Instance a65d85b2-643f-4802-bef7-c9f9891f7edd could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:04:31.019787 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c32c9d99-884f-4133-bd19-a3bb6ed27984 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd" status: 404 len: 111 microversion: 2.1 time: 0.035076 May 19 14:04:31.019787 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 545/1075] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:04:30 2022] GET /compute/v2.1/servers/a65d85b2-643f-4802-bef7-c9f9891f7edd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:04:32.157682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:32.158210 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:32.165338 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:32.165799 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:32.166581 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:32.167055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:32.182232 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] HTTP exception thrown: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Request method failure captured: May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 HTTP/1.1 May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihk1S-tf-0b4m2-9a_IbBNs4f_h-_4iPgz6ZfXcuET3MS3GumBp90VeGvf2ZJeQnmSjbPqxu_XtHjlCK8_Q7XnIZAo13JgfZ3kkc88TByX1HnvvBNZEbLGWWi0nHibVvenY7A_REw9FN4V6m3VL_OOGVWZzyhWtDAn0GuNyVkziyBh-c May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:04:32.183866 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}] May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: ab1b34a915464792b5d3b74956bc49a2 May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.185430 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5'} May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:04:32.186319 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.187724 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:32.189194 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Returning 404 to user: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:04:32.189194 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f430264e-1194-4865-94ed-0a1206fdaf30 tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "DELETE /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 404 len: 111 microversion: 2.1 time: 0.031457 May 19 14:04:32.189194 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 531/1076] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:04:32 2022] DELETE /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:04:32.194443 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:32.195084 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] [instance: 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:04:32.201657 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:32.202105 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:32.202879 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:04:32.203327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:04:32.217770 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] HTTP exception thrown: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Request method failure captured: May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 HTTP/1.1 May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihk1S-tf-0b4m2-9a_IbBNs4f_h-_4iPgz6ZfXcuET3MS3GumBp90VeGvf2ZJeQnmSjbPqxu_XtHjlCK8_Q7XnIZAo13JgfZ3kkc88TByX1HnvvBNZEbLGWWi0nHibVvenY7A_REw9FN4V6m3VL_OOGVWZzyhWtDAn0GuNyVkziyBh-c May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:04:32.219383 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e14dac6dd56c4f93b65ad91673debf71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e14dac6dd56c4f93b65ad91673debf71"}]}] May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: e14dac6dd56c4f93b65ad91673debf71 May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1233068734 May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: ab1b34a915464792b5d3b74956bc49a2 May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-AttachVolumeTestJSON-1233068734-project May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.221376 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': '954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5'} May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:04:32.222812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. May 19 14:04:32.224330 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:04:32.225646 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] Returning 404 to user: Instance 954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:04:32.225646 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-12c869f6-b893-4ed8-a6e1-7581aa8a687b tempest-AttachVolumeTestJSON-1233068734 tempest-AttachVolumeTestJSON-1233068734-project] 10.222.0.52 "GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5" status: 404 len: 111 microversion: 2.1 time: 0.030599 May 19 14:04:32.225646 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 546/1077] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:04:32 2022] GET /compute/v2.1/servers/954a7439-0dfd-4a64-b2f0-1a96fe8a4dd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:04:36.703982 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2986b868-3c37-4189-a230-1b80d57bc1a2 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] Action: 'create', calling method: .version_select at 0x7f5de1ef15e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1253398533", "metadata": {"Type": "work"}}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:04:36.994125 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2986b868-3c37-4189-a230-1b80d57bc1a2 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.412144 May 19 14:04:36.994763 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 532/1078] 10.222.0.52 () {60 vars in 1155 bytes} [Thu May 19 14:04:36 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 414 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 14:04:37.006091 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6db0a559-985a-46d3-931e-df1c0779b658 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] Calling method '.version_select at 0x7f5de22a38b0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:37.059482 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6db0a559-985a-46d3-931e-df1c0779b658 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6" status: 200 len: 353 microversion: 2.1 time: 0.057821 May 19 14:04:37.060080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 547/1079] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 14:04:37 2022] GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:38.072278 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c87c697d-9141-4d9f-b8ca-bc211c093ab2 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] Calling method '.version_select at 0x7f5de281cee0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:38.120184 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c87c697d-9141-4d9f-b8ca-bc211c093ab2 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6" status: 200 len: 354 microversion: 2.1 time: 0.052194 May 19 14:04:38.120742 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 533/1080] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 14:04:38 2022] GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:38.132467 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-011ac71b-3640-4675-946c-04f55f89ce63 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] Calling method '.version_select at 0x7f5de22ffca0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:38.179848 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-011ac71b-3640-4675-946c-04f55f89ce63 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6" status: 200 len: 354 microversion: 2.1 time: 0.051794 May 19 14:04:38.180407 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 548/1081] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 14:04:38 2022] GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:38.192335 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6d620cf2-b76d-432f-89f8-90b0612b63c3 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] Calling method '.version_select at 0x7f5de1df3af0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:38.255200 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6d620cf2-b76d-432f-89f8-90b0612b63c3 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6" status: 202 len: 0 microversion: 2.1 time: 0.066687 May 19 14:04:38.255916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 534/1082] 10.222.0.52 () {58 vars in 1247 bytes} [Thu May 19 14:04:38 2022] DELETE /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:04:38.264510 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ee1393eb-c392-4ede-a624-d7101f367dca tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] Calling method '.version_select at 0x7f5de222ef70>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:38.314331 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ee1393eb-c392-4ede-a624-d7101f367dca tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6" status: 200 len: 353 microversion: 2.1 time: 0.053725 May 19 14:04:38.314921 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 549/1083] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 14:04:38 2022] GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:39.327842 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9e24c5b0-c3d8-43dc-a7a1-e61d0c099137 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] Calling method '.version_select at 0x7f5de1b35790>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:39.356195 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-9e24c5b0-c3d8-43dc-a7a1-e61d0c099137 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] HTTP exception thrown: Volume 01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 could not be found. May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9e24c5b0-c3d8-43dc-a7a1-e61d0c099137 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] Request method failure captured: May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 HTTP/1.1 May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihk505dKCgUqmMaIFNiPmXebCYvu9eB0_DObvMv8Abx0siKMz-cflRN0sfCSHO-ooGRrJzCUKknPB1eB7-c5nDZo_60befBVU3JF4Z61ljaYZHWRgTGEqrvHbExDIkyiE1qh1wDr6kk37H9VKuBLJmOxLxUxFgrsijTH7qFoV8shtvcs May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 6c28119e5ebe4d5d99cf71063c21af1d May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesGetTestJSON-1452281705 May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:04:39.358277 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6c28119e5ebe4d5d99cf71063c21af1d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c28119e5ebe4d5d99cf71063c21af1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6c28119e5ebe4d5d99cf71063c21af1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6c28119e5ebe4d5d99cf71063c21af1d"}]}] May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesGetTestJSON-1452281705 May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 6c28119e5ebe4d5d99cf71063c21af1d May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesGetTestJSON-1452281705 May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesGetTestJSON-1452281705-project May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: 279fba51d41e4547915ea4cf2cd8b78b May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesGetTestJSON-1452281705-project May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Volume 01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 could not be found. May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6'} May 19 14:04:39.359907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 could not be found. (HTTP 404) (Request-ID: req-00db0612-618a-41f7-9483-17c78fdf9328) May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:39.360862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 14:04:39.362409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 could not be found. May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 14:04:39.363825 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 could not be found. May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 could not be found. May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9e24c5b0-c3d8-43dc-a7a1-e61d0c099137 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] Returning 404 to user: Volume 01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9e24c5b0-c3d8-43dc-a7a1-e61d0c099137 tempest-VolumesGetTestJSON-1452281705 tempest-VolumesGetTestJSON-1452281705-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6" status: 404 len: 109 microversion: 2.1 time: 0.036242 May 19 14:04:39.365201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 535/1084] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 14:04:39 2022] GET /compute/v2.1/os-volumes/01a42e4d-9cf9-4e9a-bcd4-e39f8efba1e6 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:04:42.118018 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-36de25ef-15a9-4ff2-a996-b2dd318494b3 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de241a670>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:42.165322 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-36de25ef-15a9-4ff2-a996-b2dd318494b3 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/2dd410af-ecfc-441d-91ef-f3edcc4f3928" status: 200 len: 350 microversion: 2.1 time: 0.051566 May 19 14:04:42.165887 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 550/1085] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 14:04:42 2022] GET /compute/v2.1/os-volumes/2dd410af-ecfc-441d-91ef-f3edcc4f3928 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:43.502829 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=22 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:04:43.504197 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:04:43.508738 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-50fee88e-0181-4403-8251-0222bf38e110 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de1dfa160>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:43.568059 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-50fee88e-0181-4403-8251-0222bf38e110 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/b53a95d7-960e-48ac-aa34-5d8c4e559449" status: 200 len: 350 microversion: 2.1 time: 0.067119 May 19 14:04:43.568628 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 536/1086] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 14:04:43 2022] GET /compute/v2.1/os-volumes/b53a95d7-960e-48ac-aa34-5d8c4e559449 => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:44.932073 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:04:44.932904 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:04:44.937574 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8cb960c7-557a-4796-894f-adaa497e9db3 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de21d5670>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:44.994192 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8cb960c7-557a-4796-894f-adaa497e9db3 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/3f50be92-9f50-4149-baf1-10f41a6242b3" status: 200 len: 351 microversion: 2.1 time: 0.063064 May 19 14:04:44.994910 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 551/1087] 10.222.0.52 () {58 vars in 1244 bytes} [Thu May 19 14:04:44 2022] GET /compute/v2.1/os-volumes/3f50be92-9f50-4149-baf1-10f41a6242b3 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:45.007506 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e2e3d7ee-782b-4013-b02b-140ba5b8e4bc tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de1df3af0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:45.092910 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e2e3d7ee-782b-4013-b02b-140ba5b8e4bc tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.090394 May 19 14:04:45.093484 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 537/1088] 10.222.0.52 () {58 vars in 1133 bytes} [Thu May 19 14:04:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:04:45.105656 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a1b3bb5e-75aa-48c0-a634-30edc2211346 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de222e0d0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:45.192438 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a1b3bb5e-75aa-48c0-a634-30edc2211346 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090481 May 19 14:04:45.193110 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 552/1089] 10.222.0.52 () {58 vars in 1148 bytes} [Thu May 19 14:04:45 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:45.205263 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-150cd1fe-8e6b-4bcb-b3c5-fc041ea9a71b tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de1bff8b0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:45.287917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-150cd1fe-8e6b-4bcb-b3c5-fc041ea9a71b tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086462 May 19 14:04:45.288481 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 538/1090] 10.222.0.52 () {58 vars in 1133 bytes} [Thu May 19 14:04:45 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:04:45.300365 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bb21e274-4c87-49e3-bfdd-5e0e1b741d90 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de21d5ca0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:45.386460 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bb21e274-4c87-49e3-bfdd-5e0e1b741d90 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089962 May 19 14:04:45.387712 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 553/1091] 10.222.0.52 () {58 vars in 1166 bytes} [Thu May 19 14:04:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:45.403514 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6bf71d02-d5bb-4c15-beab-a5b98d2e247b tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de27d6550>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:45.488069 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6bf71d02-d5bb-4c15-beab-a5b98d2e247b tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088347 May 19 14:04:45.488794 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 539/1092] 10.222.0.52 () {58 vars in 1169 bytes} [Thu May 19 14:04:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:04:45.500856 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-309db25f-fe0f-4c03-b713-a1ddbd308a92 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de241a310>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:45.770491 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-309db25f-fe0f-4c03-b713-a1ddbd308a92 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.273377 May 19 14:04:45.771111 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 554/1093] 10.222.0.52 () {58 vars in 1154 bytes} [Thu May 19 14:04:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:04:45.782402 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7038a053-1afe-4f2a-9156-73bd28b48129 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de1f5a550>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:45.867752 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7038a053-1afe-4f2a-9156-73bd28b48129 tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.089212 May 19 14:04:45.868414 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 540/1094] 10.222.0.52 () {58 vars in 1187 bytes} [Thu May 19 14:04:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:04:45.883151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0e12ddac-6a46-4d00-813c-e80abf243e0d tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] Calling method '.version_select at 0x7f5de222ee50>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:04:45.970982 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0e12ddac-6a46-4d00-813c-e80abf243e0d tempest-VolumesTestJSON-2018110651 tempest-VolumesTestJSON-2018110651-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090100 May 19 14:04:45.970982 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 555/1095] 10.222.0.52 () {58 vars in 1154 bytes} [Thu May 19 14:04:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:39.636084 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cc7ea46e-c29f-44aa-83f3-43b7b80c71a7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:39.636696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cc7ea46e-c29f-44aa-83f3-43b7b80c71a7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:39.642637 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc7ea46e-c29f-44aa-83f3-43b7b80c71a7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:39.643119 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc7ea46e-c29f-44aa-83f3-43b7b80c71a7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:39.643874 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc7ea46e-c29f-44aa-83f3-43b7b80c71a7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:39.644309 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc7ea46e-c29f-44aa-83f3-43b7b80c71a7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:39.670412 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cc7ea46e-c29f-44aa-83f3-43b7b80c71a7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:05:39.745660 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cc7ea46e-c29f-44aa-83f3-43b7b80c71a7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 204 len: 0 microversion: 2.1 time: 0.115285 May 19 14:05:39.746241 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 541/1096] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:05:39 2022] DELETE /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:05:39.756157 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9d6a7b4d-23b2-4cc5-bb33-38bd4bf7b7fc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:39.756969 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9d6a7b4d-23b2-4cc5-bb33-38bd4bf7b7fc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:39.764265 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9d6a7b4d-23b2-4cc5-bb33-38bd4bf7b7fc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:39.764723 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9d6a7b4d-23b2-4cc5-bb33-38bd4bf7b7fc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:39.765499 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9d6a7b4d-23b2-4cc5-bb33-38bd4bf7b7fc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:39.765943 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9d6a7b4d-23b2-4cc5-bb33-38bd4bf7b7fc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:39.897247 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9d6a7b4d-23b2-4cc5-bb33-38bd4bf7b7fc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:39.905099 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9d6a7b4d-23b2-4cc5-bb33-38bd4bf7b7fc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1575 microversion: 2.1 time: 0.154637 May 19 14:05:39.905667 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 556/1097] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:39 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:40.922687 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b94172f8-b66c-42fb-9f2e-bd0f7b9d33cd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:40.923415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b94172f8-b66c-42fb-9f2e-bd0f7b9d33cd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:40.929886 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b94172f8-b66c-42fb-9f2e-bd0f7b9d33cd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:40.931087 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b94172f8-b66c-42fb-9f2e-bd0f7b9d33cd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:40.931824 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b94172f8-b66c-42fb-9f2e-bd0f7b9d33cd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:40.932254 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b94172f8-b66c-42fb-9f2e-bd0f7b9d33cd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:41.073555 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b94172f8-b66c-42fb-9f2e-bd0f7b9d33cd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:41.081201 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b94172f8-b66c-42fb-9f2e-bd0f7b9d33cd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1575 microversion: 2.1 time: 0.163013 May 19 14:05:41.081780 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 542/1098] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:40 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:42.098995 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-0b6b38eb-90de-4f4a-8393-9c138faf903c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:42.099616 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-0b6b38eb-90de-4f4a-8393-9c138faf903c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:42.106956 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0b6b38eb-90de-4f4a-8393-9c138faf903c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:42.107413 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0b6b38eb-90de-4f4a-8393-9c138faf903c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:42.108181 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0b6b38eb-90de-4f4a-8393-9c138faf903c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:42.108620 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-0b6b38eb-90de-4f4a-8393-9c138faf903c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:42.175339 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-0b6b38eb-90de-4f4a-8393-9c138faf903c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:42.183455 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-0b6b38eb-90de-4f4a-8393-9c138faf903c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 200 len: 1508 microversion: 2.1 time: 0.088394 May 19 14:05:42.184028 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 557/1099] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:42 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 1508 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:42.496331 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-71e49216-9dec-4a47-9705-77abdf0337c5 req-496faa17-864b-45c7-aae1-32029d3618de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfea4879-afb7-4f52-99f6-c666d214000d", "name": "network-vif-deleted", "tag": "2888e720-a274-4cb2-91e2-5264abb78eda"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:05:42.512529 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-71e49216-9dec-4a47-9705-77abdf0337c5 req-496faa17-864b-45c7-aae1-32029d3618de service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:42.513706 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-71e49216-9dec-4a47-9705-77abdf0337c5 req-496faa17-864b-45c7-aae1-32029d3618de service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:42.536797 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-71e49216-9dec-4a47-9705-77abdf0337c5 req-496faa17-864b-45c7-aae1-32029d3618de service nova] Creating event network-vif-deleted:2888e720-a274-4cb2-91e2-5264abb78eda for instance bfea4879-afb7-4f52-99f6-c666d214000d on hv-cinder-78481 May 19 14:05:42.545409 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-71e49216-9dec-4a47-9705-77abdf0337c5 req-496faa17-864b-45c7-aae1-32029d3618de service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221167 May 19 14:05:42.546057 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 543/1100] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:05:43.200182 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:43.201594 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:43.208231 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:43.208691 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:43.209478 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:43.209921 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:43.224781 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] HTTP exception thrown: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Request method failure captured: May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d HTTP/1.1 May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihk4KVrQgGL17igBTQx6wu8x3HELIO5lTKl31yq7QYl6Kbcx_VydmqCUTnbExEIXYN8lciu3-fXhV8oG7xGNVoS4o7AtjrXqd1FSQgkli9yl6UQ8sS36pqK7TzFT9dx_0A6hhrlT2rsOugKiZgb9bq0YcT_v-ZWcT7V5jP3OGse7R6Xw May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:05:43.226327 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}] May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-TestVolumeBootPattern-1335792019 May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-TestVolumeBootPattern-1335792019-project May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: df54f67274d24463961e1f48dcb37447 May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-TestVolumeBootPattern-1335792019-project May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:05:43.228831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': 'bfea4879-afb7-4f52-99f6-c666d214000d'} May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:05:43.230020 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:05:43.231730 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:05:43.233151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Returning 404 to user: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:05:43.233151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-bbe80b89-07ac-476e-9315-8711539179e3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 404 len: 111 microversion: 2.1 time: 0.032376 May 19 14:05:43.233151 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 558/1101] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:43 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:05:43.340292 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-421649849", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-37618688", "security_groups": [{"name": "tempest-secgroup-smoke-860494061"}], "block_device_mapping_v2": [{"uuid": "16ee907b-e640-4e6f-8b13-52d4308b3fb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa748ea7-654e-47dd-89a8-e6366b098088"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:05:43.477050 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] validate_networks() for [('aa748ea7-654e-47dd-89a8-e6366b098088', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 14:05:43.954492 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 14:05:43.955111 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 14:05:43.955418 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 14:05:43.955826 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 14:05:43.956243 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 14:05:43.965609 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:43.966060 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:43.966884 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:43.967325 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:43.984494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Getting quotas for project 6d87d3963b1b4fb29e09d8f72f64fb6e. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 14:05:43.988424 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Getting quotas for user df54f67274d24463961e1f48dcb37447 and project 6d87d3963b1b4fb29e09d8f72f64fb6e. Resources: {'ram', 'cores', 'instances'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 14:05:44.047827 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 14:05:44.050006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16ee907b-e640-4e6f-8b13-52d4308b3fb2',volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 14:05:44.185435 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-58666268-e3f6-46f2-a2e7-5839c77b6098 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.850293 May 19 14:05:44.186084 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 544/1102] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 14:05:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 14:05:44.197013 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-a2fd4419-4ad0-43f4-91d4-d9268399dc85 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:44.197763 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-a2fd4419-4ad0-43f4-91d4-d9268399dc85 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:44.252475 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-a2fd4419-4ad0-43f4-91d4-d9268399dc85 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:44.260662 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-a2fd4419-4ad0-43f4-91d4-d9268399dc85 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1092 microversion: 2.1 time: 0.067604 May 19 14:05:44.261229 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 559/1103] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:44 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:45.279635 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ab414683-77a7-47cb-9bb5-768b386eec68 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:45.280384 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ab414683-77a7-47cb-9bb5-768b386eec68 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:45.333135 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ab414683-77a7-47cb-9bb5-768b386eec68 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:45.340503 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ab414683-77a7-47cb-9bb5-768b386eec68 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1092 microversion: 2.1 time: 0.065907 May 19 14:05:45.341086 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 545/1104] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:45 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1092 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:46.360263 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-c67c1322-f36d-48fd-bcc6-2468eacbf5e1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:46.360884 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-c67c1322-f36d-48fd-bcc6-2468eacbf5e1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:46.413356 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-c67c1322-f36d-48fd-bcc6-2468eacbf5e1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:46.421780 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-c67c1322-f36d-48fd-bcc6-2468eacbf5e1 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1092 microversion: 2.1 time: 0.065340 May 19 14:05:46.422638 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 560/1105] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:46 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1092 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:47.439182 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-40a5e645-8d36-4f26-bff4-0822c354926c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:47.439791 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-40a5e645-8d36-4f26-bff4-0822c354926c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:47.494956 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-40a5e645-8d36-4f26-bff4-0822c354926c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:47.501582 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-40a5e645-8d36-4f26-bff4-0822c354926c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1092 microversion: 2.1 time: 0.066330 May 19 14:05:47.502132 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 546/1106] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:47 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1092 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:48.518390 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1c8ad9e4-8924-4e9e-b77d-b4437f34c78d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:48.519058 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1c8ad9e4-8924-4e9e-b77d-b4437f34c78d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:48.526841 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1c8ad9e4-8924-4e9e-b77d-b4437f34c78d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:48.527333 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1c8ad9e4-8924-4e9e-b77d-b4437f34c78d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:48.528200 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1c8ad9e4-8924-4e9e-b77d-b4437f34c78d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:48.528640 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1c8ad9e4-8924-4e9e-b77d-b4437f34c78d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:48.590938 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1c8ad9e4-8924-4e9e-b77d-b4437f34c78d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:48.598710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1c8ad9e4-8924-4e9e-b77d-b4437f34c78d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1142 microversion: 2.1 time: 0.084123 May 19 14:05:48.599316 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 561/1107] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:48 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:49.615749 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b7156498-f452-4f5b-ae87-ac84c20c6758 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:49.616371 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b7156498-f452-4f5b-ae87-ac84c20c6758 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:49.624720 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7156498-f452-4f5b-ae87-ac84c20c6758 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:49.625197 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7156498-f452-4f5b-ae87-ac84c20c6758 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:49.626115 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7156498-f452-4f5b-ae87-ac84c20c6758 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:49.626560 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7156498-f452-4f5b-ae87-ac84c20c6758 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:49.702098 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b7156498-f452-4f5b-ae87-ac84c20c6758 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:49.710143 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b7156498-f452-4f5b-ae87-ac84c20c6758 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1208 microversion: 2.1 time: 0.098048 May 19 14:05:49.710712 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 547/1108] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:49 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:50.729538 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ca5ad33c-1dbb-4de3-8783-2e5c69c35908 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:50.731190 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ca5ad33c-1dbb-4de3-8783-2e5c69c35908 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:50.737482 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ca5ad33c-1dbb-4de3-8783-2e5c69c35908 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:50.737954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ca5ad33c-1dbb-4de3-8783-2e5c69c35908 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:50.738726 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ca5ad33c-1dbb-4de3-8783-2e5c69c35908 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:50.739260 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ca5ad33c-1dbb-4de3-8783-2e5c69c35908 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:50.770757 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-ff8b1aa1-c403-4a59-91c9-7381cae224b7 req-2a85efcd-3ad5-496a-a91f-7ee9f79fdee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead20f1e-6759-41d6-898c-1371fda58169", "tag": "c69ecd94-7c80-4372-b4e1-ffb5f045968f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:05:50.786052 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ff8b1aa1-c403-4a59-91c9-7381cae224b7 req-2a85efcd-3ad5-496a-a91f-7ee9f79fdee5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:50.786690 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ff8b1aa1-c403-4a59-91c9-7381cae224b7 req-2a85efcd-3ad5-496a-a91f-7ee9f79fdee5 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:50.818590 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-ff8b1aa1-c403-4a59-91c9-7381cae224b7 req-2a85efcd-3ad5-496a-a91f-7ee9f79fdee5 service nova] Creating event network-changed:c69ecd94-7c80-4372-b4e1-ffb5f045968f for instance ead20f1e-6759-41d6-898c-1371fda58169 on hv-cinder-78481 May 19 14:05:50.829862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-ff8b1aa1-c403-4a59-91c9-7381cae224b7 req-2a85efcd-3ad5-496a-a91f-7ee9f79fdee5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066328 May 19 14:05:50.831159 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 548/1109] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:05:50.995993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ca5ad33c-1dbb-4de3-8783-2e5c69c35908 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:51.005132 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ca5ad33c-1dbb-4de3-8783-2e5c69c35908 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.280300 May 19 14:05:51.005820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 562/1110] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:50 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:52.029118 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bf633f38-f21f-43af-ab1f-e99e0fed2e91 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:52.029915 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bf633f38-f21f-43af-ab1f-e99e0fed2e91 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:52.037252 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf633f38-f21f-43af-ab1f-e99e0fed2e91 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:52.037699 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf633f38-f21f-43af-ab1f-e99e0fed2e91 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:52.038462 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf633f38-f21f-43af-ab1f-e99e0fed2e91 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:52.038926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf633f38-f21f-43af-ab1f-e99e0fed2e91 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:52.178753 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bf633f38-f21f-43af-ab1f-e99e0fed2e91 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:52.187189 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bf633f38-f21f-43af-ab1f-e99e0fed2e91 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.162200 May 19 14:05:52.187764 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 549/1111] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:52 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:53.204481 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5a5b17ce-8aed-474d-a33e-e563e4f29e81 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:53.205123 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5a5b17ce-8aed-474d-a33e-e563e4f29e81 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:53.211868 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a5b17ce-8aed-474d-a33e-e563e4f29e81 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:53.212416 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a5b17ce-8aed-474d-a33e-e563e4f29e81 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:53.213206 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a5b17ce-8aed-474d-a33e-e563e4f29e81 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:53.213645 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5a5b17ce-8aed-474d-a33e-e563e4f29e81 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:53.350163 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5a5b17ce-8aed-474d-a33e-e563e4f29e81 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:53.358005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5a5b17ce-8aed-474d-a33e-e563e4f29e81 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.157421 May 19 14:05:53.358586 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 563/1112] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:53 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:54.374972 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7b962762-21ce-46b2-8767-11b9d8645858 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:54.375779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7b962762-21ce-46b2-8767-11b9d8645858 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:54.379677 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:05:54.389024 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b962762-21ce-46b2-8767-11b9d8645858 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:54.389480 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b962762-21ce-46b2-8767-11b9d8645858 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:54.390279 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b962762-21ce-46b2-8767-11b9d8645858 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:54.390720 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b962762-21ce-46b2-8767-11b9d8645858 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:54.535333 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7b962762-21ce-46b2-8767-11b9d8645858 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:54.543460 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7b962762-21ce-46b2-8767-11b9d8645858 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.172332 May 19 14:05:54.544047 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 550/1113] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:54 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:55.560551 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-1a71e64b-06c4-4ac0-903e-a58c5442edf3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:55.561100 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-1a71e64b-06c4-4ac0-903e-a58c5442edf3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:55.567505 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1a71e64b-06c4-4ac0-903e-a58c5442edf3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:55.567952 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1a71e64b-06c4-4ac0-903e-a58c5442edf3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:55.568706 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1a71e64b-06c4-4ac0-903e-a58c5442edf3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:55.569143 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-1a71e64b-06c4-4ac0-903e-a58c5442edf3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:55.699831 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-1a71e64b-06c4-4ac0-903e-a58c5442edf3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:55.707166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-1a71e64b-06c4-4ac0-903e-a58c5442edf3 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.150623 May 19 14:05:55.707717 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 564/1114] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:55 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:56.726018 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4c5be8eb-d374-4280-a045-008d98a89c29 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:56.726912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4c5be8eb-d374-4280-a045-008d98a89c29 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:56.734907 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4c5be8eb-d374-4280-a045-008d98a89c29 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:56.735498 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4c5be8eb-d374-4280-a045-008d98a89c29 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:56.736355 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4c5be8eb-d374-4280-a045-008d98a89c29 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:56.736904 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4c5be8eb-d374-4280-a045-008d98a89c29 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:56.907530 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4c5be8eb-d374-4280-a045-008d98a89c29 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:56.918652 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4c5be8eb-d374-4280-a045-008d98a89c29 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.197046 May 19 14:05:56.919456 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 551/1115] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:56 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:05:57.934993 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-5e6bff81-b073-49a5-8a44-9a247fe6dd1c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:57.935598 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-5e6bff81-b073-49a5-8a44-9a247fe6dd1c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:57.937470 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=4 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:05:57.943404 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5e6bff81-b073-49a5-8a44-9a247fe6dd1c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:57.943857 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5e6bff81-b073-49a5-8a44-9a247fe6dd1c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:57.944654 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5e6bff81-b073-49a5-8a44-9a247fe6dd1c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:57.945095 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-5e6bff81-b073-49a5-8a44-9a247fe6dd1c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:58.071928 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-5e6bff81-b073-49a5-8a44-9a247fe6dd1c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:58.079321 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-5e6bff81-b073-49a5-8a44-9a247fe6dd1c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.148305 May 19 14:05:58.079888 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 565/1116] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:57 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:05:59.096164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d5491796-3e1f-4de4-8fb6-1be3b1109a6f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:05:59.096765 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d5491796-3e1f-4de4-8fb6-1be3b1109a6f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:05:59.098642 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=10 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:05:59.105485 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5491796-3e1f-4de4-8fb6-1be3b1109a6f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:59.105934 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5491796-3e1f-4de4-8fb6-1be3b1109a6f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:59.106720 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5491796-3e1f-4de4-8fb6-1be3b1109a6f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:05:59.107186 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5491796-3e1f-4de4-8fb6-1be3b1109a6f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:05:59.250280 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d5491796-3e1f-4de4-8fb6-1be3b1109a6f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:05:59.257963 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d5491796-3e1f-4de4-8fb6-1be3b1109a6f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.165707 May 19 14:05:59.258787 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 552/1117] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:05:59 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:05:59.394690 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:05:59.395363 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Thu May 19 14:05:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:06:00.276807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-431eb43f-669a-403d-aff1-36fa3761e580 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:06:00.277423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-431eb43f-669a-403d-aff1-36fa3761e580 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:06:00.284236 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-431eb43f-669a-403d-aff1-36fa3761e580 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:00.284687 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-431eb43f-669a-403d-aff1-36fa3761e580 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:00.285459 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-431eb43f-669a-403d-aff1-36fa3761e580 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:00.285891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-431eb43f-669a-403d-aff1-36fa3761e580 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:00.420670 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-431eb43f-669a-403d-aff1-36fa3761e580 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:06:00.428167 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-431eb43f-669a-403d-aff1-36fa3761e580 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.156515 May 19 14:06:00.428755 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 566/1118] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:06:00 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:06:00.713454 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-9a005152-e661-4d58-aa77-7c9337588ce5 req-4cc08ab9-398d-475f-bf8b-1b8c802ee6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead20f1e-6759-41d6-898c-1371fda58169", "name": "network-vif-plugged", "status": "completed", "tag": "c69ecd94-7c80-4372-b4e1-ffb5f045968f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:06:00.721945 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9a005152-e661-4d58-aa77-7c9337588ce5 req-4cc08ab9-398d-475f-bf8b-1b8c802ee6dd service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:00.722816 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9a005152-e661-4d58-aa77-7c9337588ce5 req-4cc08ab9-398d-475f-bf8b-1b8c802ee6dd service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:00.733607 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-9a005152-e661-4d58-aa77-7c9337588ce5 req-4cc08ab9-398d-475f-bf8b-1b8c802ee6dd service nova] Creating event network-vif-plugged:c69ecd94-7c80-4372-b4e1-ffb5f045968f for instance ead20f1e-6759-41d6-898c-1371fda58169 on hv-cinder-78481 May 19 14:06:00.738801 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-9a005152-e661-4d58-aa77-7c9337588ce5 req-4cc08ab9-398d-475f-bf8b-1b8c802ee6dd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091654 May 19 14:06:00.739419 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 553/1119] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:06:01.444793 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b1e2f4b9-8d78-416c-bcf3-d7a265991133 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:06:01.445405 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b1e2f4b9-8d78-416c-bcf3-d7a265991133 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:06:01.452071 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b1e2f4b9-8d78-416c-bcf3-d7a265991133 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:01.452521 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b1e2f4b9-8d78-416c-bcf3-d7a265991133 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:01.453287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b1e2f4b9-8d78-416c-bcf3-d7a265991133 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:01.453723 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b1e2f4b9-8d78-416c-bcf3-d7a265991133 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:01.589102 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b1e2f4b9-8d78-416c-bcf3-d7a265991133 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:06:01.596590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b1e2f4b9-8d78-416c-bcf3-d7a265991133 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1263 microversion: 2.1 time: 0.155667 May 19 14:06:01.597163 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 567/1120] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:06:01 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:06:02.614611 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-10c18d00-7495-43a4-a374-27d70d46e169 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:06:02.615338 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-10c18d00-7495-43a4-a374-27d70d46e169 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:06:02.622781 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10c18d00-7495-43a4-a374-27d70d46e169 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:02.623253 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10c18d00-7495-43a4-a374-27d70d46e169 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:02.624011 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10c18d00-7495-43a4-a374-27d70d46e169 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:02.624446 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-10c18d00-7495-43a4-a374-27d70d46e169 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:02.752331 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-10c18d00-7495-43a4-a374-27d70d46e169 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:06:02.760358 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-10c18d00-7495-43a4-a374-27d70d46e169 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1450 microversion: 2.1 time: 0.149959 May 19 14:06:02.760924 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 554/1121] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:06:02 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1450 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:06:02.777193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-27831a15-ed32-4b8b-9678-4156929346bb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:06:02.777816 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-27831a15-ed32-4b8b-9678-4156929346bb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:06:02.784270 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-27831a15-ed32-4b8b-9678-4156929346bb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:02.784720 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-27831a15-ed32-4b8b-9678-4156929346bb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:02.785492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-27831a15-ed32-4b8b-9678-4156929346bb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:02.785930 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-27831a15-ed32-4b8b-9678-4156929346bb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:02.920891 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-27831a15-ed32-4b8b-9678-4156929346bb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:06:02.928500 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-27831a15-ed32-4b8b-9678-4156929346bb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1450 microversion: 2.1 time: 0.156142 May 19 14:06:02.929072 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 568/1122] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:06:02 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1450 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:06:04.757223 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-15faeca7-c54c-456d-8717-f3ddc5fce870 req-5c45de22-dcf5-412e-8c9e-4e2d06cf71f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead20f1e-6759-41d6-898c-1371fda58169", "tag": "c69ecd94-7c80-4372-b4e1-ffb5f045968f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:06:04.766158 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-15faeca7-c54c-456d-8717-f3ddc5fce870 req-5c45de22-dcf5-412e-8c9e-4e2d06cf71f3 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:06:04.766602 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-15faeca7-c54c-456d-8717-f3ddc5fce870 req-5c45de22-dcf5-412e-8c9e-4e2d06cf71f3 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:06:04.778085 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-15faeca7-c54c-456d-8717-f3ddc5fce870 req-5c45de22-dcf5-412e-8c9e-4e2d06cf71f3 service nova] Creating event network-changed:c69ecd94-7c80-4372-b4e1-ffb5f045968f for instance ead20f1e-6759-41d6-898c-1371fda58169 on hv-cinder-78481 May 19 14:06:04.782984 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-15faeca7-c54c-456d-8717-f3ddc5fce870 req-5c45de22-dcf5-412e-8c9e-4e2d06cf71f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029413 May 19 14:06:04.783684 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 555/1123] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:06:08.484926 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:06:08.485604 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Thu May 19 14:06:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:07:10.184499 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:07:10.185313 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Thu May 19 14:07:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:07:49.784106 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c32993d2-6fed-4371-848b-8159f59efccf] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 19 14:07:49.786999 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=30 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:07:49.788326 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=62 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:07:49.796615 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1638751485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-37618688", "security_groups": [{"name": "tempest-secgroup-smoke-860494061"}], "block_device_mapping_v2": [{"uuid": "4bf1bdc1-c3f8-4e24-a7c2-1e3ef8f5cee6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "aa748ea7-654e-47dd-89a8-e6366b098088"}]}} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:07:49.983000 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.network.neutron [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] validate_networks() for [('aa748ea7-654e-47dd-89a8-e6366b098088', None, None, None, None, None)] {{(pid=123751) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 19 14:07:50.709765 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Flavor limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 14:07:50.710524 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Image limits 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 14:07:50.711423 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Flavor pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 14:07:50.712162 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Image pref 0:0:0 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 14:07:50.712899 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.virt.hardware [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123751) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 14:07:50.731820 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:50.732624 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:50.734051 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:50.734954 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:50.769026 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Getting quotas for project 6d87d3963b1b4fb29e09d8f72f64fb6e. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 14:07:50.777344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.quota [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Getting quotas for user df54f67274d24463961e1f48dcb37447 and project 6d87d3963b1b4fb29e09d8f72f64fb6e. Resources: {'ram', 'cores', 'instances'} {{(pid=123751) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 14:07:50.811452 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO oslo.messaging._drivers.impl_rabbit [-] [c32993d2-6fed-4371-848b-8159f59efccf] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 48284. May 19 14:07:50.868642 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Going to run 1 instances... {{(pid=123751) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 14:07:50.873052 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bf1bdc1-c3f8-4e24-a7c2-1e3ef8f5cee6',volume_size=None,volume_type=None)] {{(pid=123751) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 14:07:51.078212 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-6b49a19f-c937-4600-a4fe-8c3b1d2b03c9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.297306 May 19 14:07:51.079371 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 569/1124] 10.222.0.52 () {60 vars in 1146 bytes} [Thu May 19 14:07:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 14:07:51.092713 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:07:51.093985 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:07:51.099628 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f263c5aa-9005-4024-8605-bd7a42a8f57d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:07:51.100929 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f263c5aa-9005-4024-8605-bd7a42a8f57d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:07:51.185727 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f263c5aa-9005-4024-8605-bd7a42a8f57d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:07:51.197494 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f263c5aa-9005-4024-8605-bd7a42a8f57d tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1093 microversion: 2.1 time: 0.107912 May 19 14:07:51.199621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 556/1125] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:07:51 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1093 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:07:52.226393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9a943354-ff5b-4849-bcaa-2d2b26d231f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:07:52.227282 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9a943354-ff5b-4849-bcaa-2d2b26d231f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:07:52.236193 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9a943354-ff5b-4849-bcaa-2d2b26d231f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:52.236710 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9a943354-ff5b-4849-bcaa-2d2b26d231f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:52.237511 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9a943354-ff5b-4849-bcaa-2d2b26d231f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:52.237964 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9a943354-ff5b-4849-bcaa-2d2b26d231f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:52.305398 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-9a943354-ff5b-4849-bcaa-2d2b26d231f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:07:52.314625 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9a943354-ff5b-4849-bcaa-2d2b26d231f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1191 microversion: 2.1 time: 0.094071 May 19 14:07:52.315384 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 570/1126] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:07:52 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:07:53.347006 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bf0ea99d-3f75-4d0f-8634-b461ab42e873 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:07:53.349091 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bf0ea99d-3f75-4d0f-8634-b461ab42e873 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:07:53.363028 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf0ea99d-3f75-4d0f-8634-b461ab42e873 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:53.364208 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf0ea99d-3f75-4d0f-8634-b461ab42e873 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:53.365582 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf0ea99d-3f75-4d0f-8634-b461ab42e873 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:53.366356 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf0ea99d-3f75-4d0f-8634-b461ab42e873 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:53.742540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bf0ea99d-3f75-4d0f-8634-b461ab42e873 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:07:53.754267 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bf0ea99d-3f75-4d0f-8634-b461ab42e873 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1276 microversion: 2.1 time: 0.416973 May 19 14:07:53.755595 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 557/1127] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:07:53 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1276 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:07:54.489377 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-871c9e20-74fe-446a-8b69-af1ec517af62 req-acc6337e-be78-47e9-b7e4-c29609017b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acf3a8f-6c99-4f8e-a75a-2f1b1183682e", "tag": "1be29939-edb9-4b23-859f-5cf23a322467"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:07:54.500358 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-871c9e20-74fe-446a-8b69-af1ec517af62 req-acc6337e-be78-47e9-b7e4-c29609017b7b service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:54.501096 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-871c9e20-74fe-446a-8b69-af1ec517af62 req-acc6337e-be78-47e9-b7e4-c29609017b7b service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:54.532409 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-871c9e20-74fe-446a-8b69-af1ec517af62 req-acc6337e-be78-47e9-b7e4-c29609017b7b service nova] Creating event network-changed:1be29939-edb9-4b23-859f-5cf23a322467 for instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e on hv-cinder-78481 May 19 14:07:54.543134 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-871c9e20-74fe-446a-8b69-af1ec517af62 req-acc6337e-be78-47e9-b7e4-c29609017b7b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056228 May 19 14:07:54.544241 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 571/1128] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:07:54.776328 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a9d35e8f-d2d2-4ca1-af88-3f38eb0f0bbd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:07:54.777490 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a9d35e8f-d2d2-4ca1-af88-3f38eb0f0bbd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:07:54.785779 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9d35e8f-d2d2-4ca1-af88-3f38eb0f0bbd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:54.786419 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9d35e8f-d2d2-4ca1-af88-3f38eb0f0bbd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:54.787343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9d35e8f-d2d2-4ca1-af88-3f38eb0f0bbd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:54.787860 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a9d35e8f-d2d2-4ca1-af88-3f38eb0f0bbd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:55.044527 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a9d35e8f-d2d2-4ca1-af88-3f38eb0f0bbd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:07:55.052952 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a9d35e8f-d2d2-4ca1-af88-3f38eb0f0bbd tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.280942 May 19 14:07:55.053533 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 558/1129] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:07:54 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:07:56.077289 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-037ea9c9-0242-40c6-aa01-13f16937fbdb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:07:56.078548 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-037ea9c9-0242-40c6-aa01-13f16937fbdb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:07:56.090900 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-037ea9c9-0242-40c6-aa01-13f16937fbdb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:56.091722 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-037ea9c9-0242-40c6-aa01-13f16937fbdb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:56.093163 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-037ea9c9-0242-40c6-aa01-13f16937fbdb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:56.093987 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-037ea9c9-0242-40c6-aa01-13f16937fbdb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:56.352067 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-037ea9c9-0242-40c6-aa01-13f16937fbdb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:07:56.365671 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-037ea9c9-0242-40c6-aa01-13f16937fbdb tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.296252 May 19 14:07:56.366842 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 572/1130] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:07:56 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:07:57.478489 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-47f54360-4ccf-4a8d-a38c-123b5876e1d5 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:07:57.480621 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-47f54360-4ccf-4a8d-a38c-123b5876e1d5 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:07:57.486678 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-47f54360-4ccf-4a8d-a38c-123b5876e1d5 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:57.487371 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-47f54360-4ccf-4a8d-a38c-123b5876e1d5 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:57.488189 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-47f54360-4ccf-4a8d-a38c-123b5876e1d5 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:57.488670 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-47f54360-4ccf-4a8d-a38c-123b5876e1d5 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:57.648521 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-47f54360-4ccf-4a8d-a38c-123b5876e1d5 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:07:57.657486 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-47f54360-4ccf-4a8d-a38c-123b5876e1d5 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.269071 May 19 14:07:57.658086 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 559/1131] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:07:57 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:07:58.686198 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-7a513ab5-48fa-4c72-bbe2-16f5234cdf00 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:07:58.687213 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-7a513ab5-48fa-4c72-bbe2-16f5234cdf00 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:07:58.699145 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7a513ab5-48fa-4c72-bbe2-16f5234cdf00 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:58.699828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7a513ab5-48fa-4c72-bbe2-16f5234cdf00 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:58.700870 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7a513ab5-48fa-4c72-bbe2-16f5234cdf00 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:58.701311 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-7a513ab5-48fa-4c72-bbe2-16f5234cdf00 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:58.863297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-7a513ab5-48fa-4c72-bbe2-16f5234cdf00 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:07:58.873166 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-7a513ab5-48fa-4c72-bbe2-16f5234cdf00 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.193863 May 19 14:07:58.874187 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 573/1132] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:07:58 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:07:59.895658 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ba27296f-8393-4dad-93a2-7ec207a4c117 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:07:59.896311 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ba27296f-8393-4dad-93a2-7ec207a4c117 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:07:59.903682 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ba27296f-8393-4dad-93a2-7ec207a4c117 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:59.904136 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ba27296f-8393-4dad-93a2-7ec207a4c117 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:07:59.904908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ba27296f-8393-4dad-93a2-7ec207a4c117 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:07:59.905343 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ba27296f-8393-4dad-93a2-7ec207a4c117 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:00.055382 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ba27296f-8393-4dad-93a2-7ec207a4c117 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:08:00.065983 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ba27296f-8393-4dad-93a2-7ec207a4c117 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.174927 May 19 14:08:00.066904 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 560/1133] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:07:59 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:08:01.084582 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b0d0af08-9e3d-4dc9-9659-7548a0c73ef2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:08:01.085194 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b0d0af08-9e3d-4dc9-9659-7548a0c73ef2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:08:01.087621 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=2 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:08:01.088826 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell0:SELECT=6 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:08:01.095302 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b0d0af08-9e3d-4dc9-9659-7548a0c73ef2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:01.095771 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b0d0af08-9e3d-4dc9-9659-7548a0c73ef2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:01.096550 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b0d0af08-9e3d-4dc9-9659-7548a0c73ef2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:01.096991 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b0d0af08-9e3d-4dc9-9659-7548a0c73ef2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:01.265776 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b0d0af08-9e3d-4dc9-9659-7548a0c73ef2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:08:01.278812 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b0d0af08-9e3d-4dc9-9659-7548a0c73ef2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.198203 May 19 14:08:01.279492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 574/1134] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:08:01 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:08:02.298405 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-663d4dc4-d4a5-4562-aca8-8f361dab517e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:08:02.299046 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-663d4dc4-d4a5-4562-aca8-8f361dab517e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:08:02.301420 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell0:SELECT=2 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:08:02.307055 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663d4dc4-d4a5-4562-aca8-8f361dab517e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:02.307496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663d4dc4-d4a5-4562-aca8-8f361dab517e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:02.308263 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663d4dc4-d4a5-4562-aca8-8f361dab517e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:02.308693 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663d4dc4-d4a5-4562-aca8-8f361dab517e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:02.460906 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-663d4dc4-d4a5-4562-aca8-8f361dab517e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:08:02.473578 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-663d4dc4-d4a5-4562-aca8-8f361dab517e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.181086 May 19 14:08:02.474560 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 561/1135] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:08:02 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:08:03.499107 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-b136dff2-7de4-403d-8580-46bdecea7176 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:08:03.499764 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-b136dff2-7de4-403d-8580-46bdecea7176 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:08:03.507349 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b136dff2-7de4-403d-8580-46bdecea7176 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:03.507999 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b136dff2-7de4-403d-8580-46bdecea7176 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:03.508883 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b136dff2-7de4-403d-8580-46bdecea7176 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:03.509672 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-b136dff2-7de4-403d-8580-46bdecea7176 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:03.699635 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-b136dff2-7de4-403d-8580-46bdecea7176 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:08:03.712146 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-b136dff2-7de4-403d-8580-46bdecea7176 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.217992 May 19 14:08:03.712876 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 575/1136] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:08:03 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:08:04.733945 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-696c9c00-77f2-4568-8d56-bc3ae710c2f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:08:04.734840 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-696c9c00-77f2-4568-8d56-bc3ae710c2f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:08:04.742427 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-696c9c00-77f2-4568-8d56-bc3ae710c2f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:04.742883 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-696c9c00-77f2-4568-8d56-bc3ae710c2f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:04.743671 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-696c9c00-77f2-4568-8d56-bc3ae710c2f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:04.744611 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-696c9c00-77f2-4568-8d56-bc3ae710c2f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:04.914164 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-696c9c00-77f2-4568-8d56-bc3ae710c2f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:08:04.922365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-696c9c00-77f2-4568-8d56-bc3ae710c2f2 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.194121 May 19 14:08:04.923034 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 562/1137] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:08:04 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:08:05.279186 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-80e3dda1-e005-4440-8718-efa30103c697 req-fecc7974-f87f-4dc3-832f-6f227e7a72e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acf3a8f-6c99-4f8e-a75a-2f1b1183682e", "name": "network-vif-plugged", "status": "completed", "tag": "1be29939-edb9-4b23-859f-5cf23a322467"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:08:05.295753 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-80e3dda1-e005-4440-8718-efa30103c697 req-fecc7974-f87f-4dc3-832f-6f227e7a72e1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:05.296458 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-80e3dda1-e005-4440-8718-efa30103c697 req-fecc7974-f87f-4dc3-832f-6f227e7a72e1 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:05.313967 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-80e3dda1-e005-4440-8718-efa30103c697 req-fecc7974-f87f-4dc3-832f-6f227e7a72e1 service nova] Creating event network-vif-plugged:1be29939-edb9-4b23-859f-5cf23a322467 for instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e on hv-cinder-78481 May 19 14:08:05.321112 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-80e3dda1-e005-4440-8718-efa30103c697 req-fecc7974-f87f-4dc3-832f-6f227e7a72e1 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047776 May 19 14:08:05.322022 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 576/1138] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:08:05.653726 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:08:05.654058 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Thu May 19 14:08:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:08:05.948408 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-332500e7-b7d2-477c-a3dc-6f81e109c7c4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:08:05.949438 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-332500e7-b7d2-477c-a3dc-6f81e109c7c4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:08:05.956365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-332500e7-b7d2-477c-a3dc-6f81e109c7c4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:05.956807 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-332500e7-b7d2-477c-a3dc-6f81e109c7c4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:05.957591 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-332500e7-b7d2-477c-a3dc-6f81e109c7c4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:05.958024 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-332500e7-b7d2-477c-a3dc-6f81e109c7c4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:06.116265 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-332500e7-b7d2-477c-a3dc-6f81e109c7c4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:08:06.125760 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-332500e7-b7d2-477c-a3dc-6f81e109c7c4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1264 microversion: 2.1 time: 0.181774 May 19 14:08:06.126349 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 563/1139] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:08:05 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:08:07.150612 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-15b0ecde-49cc-4cd2-b815-7b5d2f2268a9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:08:07.151606 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-15b0ecde-49cc-4cd2-b815-7b5d2f2268a9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:08:07.158222 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-15b0ecde-49cc-4cd2-b815-7b5d2f2268a9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:07.158944 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-15b0ecde-49cc-4cd2-b815-7b5d2f2268a9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:07.159821 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-15b0ecde-49cc-4cd2-b815-7b5d2f2268a9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:07.160311 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-15b0ecde-49cc-4cd2-b815-7b5d2f2268a9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:07.347297 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-15b0ecde-49cc-4cd2-b815-7b5d2f2268a9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:08:07.355845 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-15b0ecde-49cc-4cd2-b815-7b5d2f2268a9 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1451 microversion: 2.1 time: 0.210530 May 19 14:08:07.356414 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 577/1140] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:08:07 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1451 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:08:07.373092 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3312b716-e484-448b-9b0d-eee33e37adfc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:08:07.373831 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3312b716-e484-448b-9b0d-eee33e37adfc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:08:07.380330 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3312b716-e484-448b-9b0d-eee33e37adfc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:07.380771 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3312b716-e484-448b-9b0d-eee33e37adfc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:07.381537 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3312b716-e484-448b-9b0d-eee33e37adfc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:07.381975 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3312b716-e484-448b-9b0d-eee33e37adfc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:07.532375 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3312b716-e484-448b-9b0d-eee33e37adfc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:08:07.540495 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3312b716-e484-448b-9b0d-eee33e37adfc tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1451 microversion: 2.1 time: 0.171833 May 19 14:08:07.541743 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 564/1141] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:08:07 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1451 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:08:09.510650 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-a33757b4-6d6a-4ff3-b65a-b8b6720c9593 req-659794c9-34b8-4a1d-8801-e4f28a428445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acf3a8f-6c99-4f8e-a75a-2f1b1183682e", "tag": "1be29939-edb9-4b23-859f-5cf23a322467"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:08:09.519344 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-a33757b4-6d6a-4ff3-b65a-b8b6720c9593 req-659794c9-34b8-4a1d-8801-e4f28a428445 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:08:09.519783 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-a33757b4-6d6a-4ff3-b65a-b8b6720c9593 req-659794c9-34b8-4a1d-8801-e4f28a428445 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:08:09.532398 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-a33757b4-6d6a-4ff3-b65a-b8b6720c9593 req-659794c9-34b8-4a1d-8801-e4f28a428445 service nova] Creating event network-changed:1be29939-edb9-4b23-859f-5cf23a322467 for instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e on hv-cinder-78481 May 19 14:08:09.537583 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-a33757b4-6d6a-4ff3-b65a-b8b6720c9593 req-659794c9-34b8-4a1d-8801-e4f28a428445 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031399 May 19 14:08:09.538386 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 578/1142] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:09:28.493632 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:09:28.494064 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Thu May 19 14:09:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:09:38.534819 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ea7707d8-0d99-45c4-948c-31d52e10eeca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:38.536264 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.537157 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ea7707d8-0d99-45c4-948c-31d52e10eeca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:38.538917 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_api:SELECT=20 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.539721 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG dbcounter [-] [123751] Writing DB stats nova_cell1:SELECT=44 {{(pid=123751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.540128 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG dbcounter [-] [123752] Writing DB stats nova_cell1:SELECT=48 {{(pid=123752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 14:09:38.545150 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea7707d8-0d99-45c4-948c-31d52e10eeca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:38.545767 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea7707d8-0d99-45c4-948c-31d52e10eeca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:38.546496 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea7707d8-0d99-45c4-948c-31d52e10eeca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:38.546969 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea7707d8-0d99-45c4-948c-31d52e10eeca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:38.579187 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ea7707d8-0d99-45c4-948c-31d52e10eeca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:09:38.646458 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [req-a3257e16-41e3-4b11-bee6-7f5944617a7b req-3e75f0ac-58b8-4aeb-924b-800ee19fe68c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acf3a8f-6c99-4f8e-a75a-2f1b1183682e", "tag": "1be29939-edb9-4b23-859f-5cf23a322467"}]} {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:09:38.655590 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-a3257e16-41e3-4b11-bee6-7f5944617a7b req-3e75f0ac-58b8-4aeb-924b-800ee19fe68c service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:38.656042 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [req-a3257e16-41e3-4b11-bee6-7f5944617a7b req-3e75f0ac-58b8-4aeb-924b-800ee19fe68c service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:38.669299 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.compute.server_external_events [req-a3257e16-41e3-4b11-bee6-7f5944617a7b req-3e75f0ac-58b8-4aeb-924b-800ee19fe68c service nova] Creating event network-changed:1be29939-edb9-4b23-859f-5cf23a322467 for instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e on hv-cinder-78481 May 19 14:09:38.673554 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ea7707d8-0d99-45c4-948c-31d52e10eeca tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "DELETE /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 204 len: 0 microversion: 2.1 time: 0.143541 May 19 14:09:38.674613 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 565/1143] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:09:38 2022] DELETE /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:09:38.678386 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [req-a3257e16-41e3-4b11-bee6-7f5944617a7b req-3e75f0ac-58b8-4aeb-924b-800ee19fe68c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142029 May 19 14:09:38.679950 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 579/1144] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:09:38.689305 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-89a381b5-72af-448d-b7f6-733d1153016f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:38.690354 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-89a381b5-72af-448d-b7f6-733d1153016f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:38.697882 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-89a381b5-72af-448d-b7f6-733d1153016f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:38.698121 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-89a381b5-72af-448d-b7f6-733d1153016f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:38.699261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-89a381b5-72af-448d-b7f6-733d1153016f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:38.699261 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-89a381b5-72af-448d-b7f6-733d1153016f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:38.924676 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-89a381b5-72af-448d-b7f6-733d1153016f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:09:38.932431 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-89a381b5-72af-448d-b7f6-733d1153016f tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1576 microversion: 2.1 time: 0.252375 May 19 14:09:38.932994 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 566/1145] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:09:38 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:09:39.952238 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-3222c747-f7b2-4fe7-ad1d-49a0dcde6e0b tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:39.952944 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-3222c747-f7b2-4fe7-ad1d-49a0dcde6e0b tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:39.959393 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3222c747-f7b2-4fe7-ad1d-49a0dcde6e0b tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:39.959857 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3222c747-f7b2-4fe7-ad1d-49a0dcde6e0b tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:39.960629 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3222c747-f7b2-4fe7-ad1d-49a0dcde6e0b tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:39.961076 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-3222c747-f7b2-4fe7-ad1d-49a0dcde6e0b tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:40.185203 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-3222c747-f7b2-4fe7-ad1d-49a0dcde6e0b tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:09:40.194226 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-3222c747-f7b2-4fe7-ad1d-49a0dcde6e0b tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1576 microversion: 2.1 time: 0.247258 May 19 14:09:40.194888 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 580/1146] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:09:39 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:09:40.893754 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-eda4667d-5da4-4d95-b186-ca3ef484b91b req-17b4b923-ae40-4801-beb5-069c99112732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acf3a8f-6c99-4f8e-a75a-2f1b1183682e", "name": "network-vif-deleted", "tag": "1be29939-edb9-4b23-859f-5cf23a322467"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:09:40.905406 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-eda4667d-5da4-4d95-b186-ca3ef484b91b req-17b4b923-ae40-4801-beb5-069c99112732 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:40.905406 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-eda4667d-5da4-4d95-b186-ca3ef484b91b req-17b4b923-ae40-4801-beb5-069c99112732 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:40.919064 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-eda4667d-5da4-4d95-b186-ca3ef484b91b req-17b4b923-ae40-4801-beb5-069c99112732 service nova] Creating event network-vif-deleted:1be29939-edb9-4b23-859f-5cf23a322467 for instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e on hv-cinder-78481 May 19 14:09:40.924719 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-eda4667d-5da4-4d95-b186-ca3ef484b91b req-17b4b923-ae40-4801-beb5-069c99112732 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034694 May 19 14:09:40.926268 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 567/1147] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:09:41.212432 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-df77fa79-9b2f-4376-867b-3673acbfb05e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:41.213392 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-df77fa79-9b2f-4376-867b-3673acbfb05e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:41.226406 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-df77fa79-9b2f-4376-867b-3673acbfb05e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:41.227069 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-df77fa79-9b2f-4376-867b-3673acbfb05e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:41.228377 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-df77fa79-9b2f-4376-867b-3673acbfb05e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:41.229117 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-df77fa79-9b2f-4376-867b-3673acbfb05e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:41.311215 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-df77fa79-9b2f-4376-867b-3673acbfb05e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:09:41.319440 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-df77fa79-9b2f-4376-867b-3673acbfb05e tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 200 len: 1224 microversion: 2.1 time: 0.111042 May 19 14:09:41.320270 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 581/1148] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:09:41 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:09:42.339337 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:42.340031 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:42.346607 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:42.347095 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:42.347862 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:42.348296 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:42.362297 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] HTTP exception thrown: Instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e could not be found. May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Request method failure captured: May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e HTTP/1.1 May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihk4KVrQgGL17igBTQx6wu8x3HELIO5lTKl31yq7QYl6Kbcx_VydmqCUTnbExEIXYN8lciu3-fXhV8oG7xGNVoS4o7AtjrXqd1FSQgkli9yl6UQ8sS36pqK7TzFT9dx_0A6hhrlT2rsOugKiZgb9bq0YcT_v-ZWcT7V5jP3OGse7R6Xw May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:09:42.363998 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}] May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-TestVolumeBootPattern-1335792019-project May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: df54f67274d24463961e1f48dcb37447 May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-TestVolumeBootPattern-1335792019-project May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e could not be found. May 19 14:09:42.365714 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': '9acf3a8f-6c99-4f8e-a75a-2f1b1183682e'} May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e could not be found. May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:09:42.366696 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e could not be found. May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e could not be found. May 19 14:09:42.368320 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:42.369803 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Returning 404 to user: Instance 9acf3a8f-6c99-4f8e-a75a-2f1b1183682e could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:09:42.369803 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-52512f37-2a8f-4f44-84f8-30d5bae6b27a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e" status: 404 len: 111 microversion: 2.1 time: 0.030769 May 19 14:09:42.369803 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 568/1149] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:09:42 2022] GET /compute/v2.1/servers/9acf3a8f-6c99-4f8e-a75a-2f1b1183682e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:09:45.515579 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-22731568-b557-40ec-a631-b9c36f09f4ad tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:45.516128 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-22731568-b557-40ec-a631-b9c36f09f4ad tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:45.520492 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-591bd4cd-3979-4aa8-8c40-c0a36012c92c req-2aa0ff5e-fa53-41bd-a9d2-38f320b5a1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ead20f1e-6759-41d6-898c-1371fda58169", "tag": "c69ecd94-7c80-4372-b4e1-ffb5f045968f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:09:45.522813 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22731568-b557-40ec-a631-b9c36f09f4ad tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:45.523288 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22731568-b557-40ec-a631-b9c36f09f4ad tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:45.524068 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22731568-b557-40ec-a631-b9c36f09f4ad tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:45.524511 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-22731568-b557-40ec-a631-b9c36f09f4ad tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:45.533721 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-591bd4cd-3979-4aa8-8c40-c0a36012c92c req-2aa0ff5e-fa53-41bd-a9d2-38f320b5a1fe service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:45.534415 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-591bd4cd-3979-4aa8-8c40-c0a36012c92c req-2aa0ff5e-fa53-41bd-a9d2-38f320b5a1fe service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:45.548067 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-591bd4cd-3979-4aa8-8c40-c0a36012c92c req-2aa0ff5e-fa53-41bd-a9d2-38f320b5a1fe service nova] Creating event network-changed:c69ecd94-7c80-4372-b4e1-ffb5f045968f for instance ead20f1e-6759-41d6-898c-1371fda58169 on hv-cinder-78481 May 19 14:09:45.553146 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-591bd4cd-3979-4aa8-8c40-c0a36012c92c req-2aa0ff5e-fa53-41bd-a9d2-38f320b5a1fe service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038397 May 19 14:09:45.554019 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 569/1150] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 14:09:45.561793 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-22731568-b557-40ec-a631-b9c36f09f4ad tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Going to try to terminate instance {{(pid=123751) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 14:09:45.663410 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-22731568-b557-40ec-a631-b9c36f09f4ad tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "DELETE /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 204 len: 0 microversion: 2.1 time: 0.152142 May 19 14:09:45.667731 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 582/1151] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:09:45 2022] DELETE /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 14:09:45.673919 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8c2f9ad4-a0d4-4c33-a0b2-b82e8bc2377a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:45.674620 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8c2f9ad4-a0d4-4c33-a0b2-b82e8bc2377a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:45.681011 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ad4-a0d4-4c33-a0b2-b82e8bc2377a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:45.681466 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ad4-a0d4-4c33-a0b2-b82e8bc2377a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:45.682240 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ad4-a0d4-4c33-a0b2-b82e8bc2377a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:45.682935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c2f9ad4-a0d4-4c33-a0b2-b82e8bc2377a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:45.824423 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8c2f9ad4-a0d4-4c33-a0b2-b82e8bc2377a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:09:45.832800 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8c2f9ad4-a0d4-4c33-a0b2-b82e8bc2377a tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1575 microversion: 2.1 time: 0.163837 May 19 14:09:45.833365 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 570/1152] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:09:45 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 14:09:46.850205 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-ae55cfa8-7108-40ca-b106-81e3da4b50e6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:46.850927 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-ae55cfa8-7108-40ca-b106-81e3da4b50e6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:46.858480 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ae55cfa8-7108-40ca-b106-81e3da4b50e6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:46.859122 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ae55cfa8-7108-40ca-b106-81e3da4b50e6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:46.860031 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ae55cfa8-7108-40ca-b106-81e3da4b50e6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:46.860369 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-ae55cfa8-7108-40ca-b106-81e3da4b50e6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:47.017542 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-ae55cfa8-7108-40ca-b106-81e3da4b50e6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:09:47.029668 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-ae55cfa8-7108-40ca-b106-81e3da4b50e6 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1575 microversion: 2.1 time: 0.183633 May 19 14:09:47.030261 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 583/1153] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:09:46 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:09:47.842141 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-842bf711-6fbe-415e-b597-f740e5a6e1e9 req-a6ca29c3-cf42-43a5-942e-c3452c7442d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ead20f1e-6759-41d6-898c-1371fda58169", "name": "network-vif-deleted", "tag": "c69ecd94-7c80-4372-b4e1-ffb5f045968f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 14:09:47.851916 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-842bf711-6fbe-415e-b597-f740e5a6e1e9 req-a6ca29c3-cf42-43a5-942e-c3452c7442d2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:47.852479 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-842bf711-6fbe-415e-b597-f740e5a6e1e9 req-a6ca29c3-cf42-43a5-942e-c3452c7442d2 service nova] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:47.864385 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-842bf711-6fbe-415e-b597-f740e5a6e1e9 req-a6ca29c3-cf42-43a5-942e-c3452c7442d2 service nova] Creating event network-vif-deleted:c69ecd94-7c80-4372-b4e1-ffb5f045968f for instance ead20f1e-6759-41d6-898c-1371fda58169 on hv-cinder-78481 May 19 14:09:47.869815 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-842bf711-6fbe-415e-b597-f740e5a6e1e9 req-a6ca29c3-cf42-43a5-942e-c3452c7442d2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032046 May 19 14:09:47.870538 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 571/1154] 10.222.0.52 () {64 vars in 1317 bytes} [Thu May 19 14:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 14:09:48.047807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-99c890fb-59ff-4002-b303-ff3adb2aee38 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:48.048355 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-99c890fb-59ff-4002-b303-ff3adb2aee38 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:48.055011 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-99c890fb-59ff-4002-b303-ff3adb2aee38 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:48.055470 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-99c890fb-59ff-4002-b303-ff3adb2aee38 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:48.056252 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-99c890fb-59ff-4002-b303-ff3adb2aee38 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:48.057492 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-99c890fb-59ff-4002-b303-ff3adb2aee38 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:48.127962 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.policy [None req-99c890fb-59ff-4002-b303-ff3adb2aee38 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df54f67274d24463961e1f48dcb37447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d87d3963b1b4fb29e09d8f72f64fb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123751) authorize /opt/stack/nova/nova/policy.py:199}} May 19 14:09:48.138080 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-99c890fb-59ff-4002-b303-ff3adb2aee38 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 200 len: 1223 microversion: 2.1 time: 0.093755 May 19 14:09:48.139005 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 584/1155] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:09:48 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 14:09:49.157472 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:49.158167 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: ead20f1e-6759-41d6-898c-1371fda58169] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:49.164817 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:49.165260 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:49.166121 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:49.166464 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:49.180302 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] HTTP exception thrown: Instance ead20f1e-6759-41d6-898c-1371fda58169 could not be found. May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Request method failure captured: May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 HTTP/1.1 May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihk4KVrQgGL17igBTQx6wu8x3HELIO5lTKl31yq7QYl6Kbcx_VydmqCUTnbExEIXYN8lciu3-fXhV8oG7xGNVoS4o7AtjrXqd1FSQgkli9yl6UQ8sS36pqK7TzFT9dx_0A6hhrlT2rsOugKiZgb9bq0YcT_v-ZWcT7V5jP3OGse7R6Xw May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:09:49.181912 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}] May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-TestVolumeBootPattern-1335792019-project May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: df54f67274d24463961e1f48dcb37447 May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-TestVolumeBootPattern-1335792019-project May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance ead20f1e-6759-41d6-898c-1371fda58169 could not be found. May 19 14:09:49.183579 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': 'ead20f1e-6759-41d6-898c-1371fda58169'} May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ead20f1e-6759-41d6-898c-1371fda58169 could not be found. May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:09:49.185040 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ead20f1e-6759-41d6-898c-1371fda58169 could not be found. May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ead20f1e-6759-41d6-898c-1371fda58169 could not be found. May 19 14:09:49.186610 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.188176 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Returning 404 to user: Instance ead20f1e-6759-41d6-898c-1371fda58169 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:09:49.188176 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bf8859f3-a523-4dbb-ab9a-76232b7e70e4 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169" status: 404 len: 111 microversion: 2.1 time: 0.031553 May 19 14:09:49.188176 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 572/1156] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:09:49 2022] GET /compute/v2.1/servers/ead20f1e-6759-41d6-898c-1371fda58169 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 14:09:49.647041 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:49.647602 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.compute.api [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123751) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:49.654374 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:49.654828 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:49.655639 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:49.656077 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG oslo_concurrency.lockutils [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:49.670240 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.wsgi [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] HTTP exception thrown: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Request method failure captured: May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: request: DELETE /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d HTTP/1.1 May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept: application/json May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Accept-Encoding: identity May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Connection: close May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Length: 0 May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Content-Type: application/json May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Host: 10.222.0.52 May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Openstack-System-Scope: None May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: User-Agent: python-urllib3/1.26.9 May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Auth-Token: gAAAAABihk4KVrQgGL17igBTQx6wu8x3HELIO5lTKl31yq7QYl6Kbcx_VydmqCUTnbExEIXYN8lciu3-fXhV8oG7xGNVoS4o7AtjrXqd1FSQgkli9yl6UQ8sS36pqK7TzFT9dx_0A6hhrlT2rsOugKiZgb9bq0YcT_v-ZWcT7V5jP3OGse7R6Xw May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Id: None May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Domain-Name: None May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Identity-Status: Confirmed May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Is-Admin-Project: True May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Id: default May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Domain-Name: Default May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Project-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Role: member,reader May 19 14:09:49.671961 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Roles: member,reader May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}] May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User: tempest-TestVolumeBootPattern-1335792019-project May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Id: default May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Domain-Name: Default May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Id: df54f67274d24463961e1f48dcb37447 May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: X-User-Name: tempest-TestVolumeBootPattern-1335792019-project May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: method: > May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: exception: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.673810 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: action_args: {'id': 'bfea4879-afb7-4f52-99f6-c666d214000d'} May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:09:49.675014 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.676728 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: ERROR nova.api.openstack.wsgi May 19 14:09:49.678287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Returning 404 to user: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. {{(pid=123751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:09:49.678287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-9c820a31-4126-48e2-9763-e4e3443c965c tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 404 len: 111 microversion: 2.1 time: 0.030241 May 19 14:09:49.678287 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 585/1157] 10.222.0.52 () {58 vars in 1238 bytes} [Thu May 19 14:09:49 2022] DELETE /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:09:49.682151 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:49.682755 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] [instance: bfea4879-afb7-4f52-99f6-c666d214000d] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 14:09:49.689996 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:49.690442 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:49.691271 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 14:09:49.691709 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Lock "15aabb13-0547-4fea-a3a2-4403ba090ba7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 14:09:49.708390 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] HTTP exception thrown: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Request method failure captured: May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d HTTP/1.1 May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept: application/json May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Connection: close May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Host: 10.222.0.52 May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABihk4KVrQgGL17igBTQx6wu8x3HELIO5lTKl31yq7QYl6Kbcx_VydmqCUTnbExEIXYN8lciu3-fXhV8oG7xGNVoS4o7AtjrXqd1FSQgkli9yl6UQ8sS36pqK7TzFT9dx_0A6hhrlT2rsOugKiZgb9bq0YcT_v-ZWcT7V5jP3OGse7R6Xw May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 19 14:09:49.709935 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6d87d3963b1b4fb29e09d8f72f64fb6e"}]}] May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 6d87d3963b1b4fb29e09d8f72f64fb6e May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-TestVolumeBootPattern-1335792019 May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User: tempest-TestVolumeBootPattern-1335792019-project May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Id: df54f67274d24463961e1f48dcb37447 May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-TestVolumeBootPattern-1335792019-project May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: method: > May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: exception: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.712022 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: action_args: {'id': 'bfea4879-afb7-4f52-99f6-c666d214000d'} May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 14:09:49.713301 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. May 19 14:09:49.716908 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 19 14:09:49.719443 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Returning 404 to user: Instance bfea4879-afb7-4f52-99f6-c666d214000d could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 14:09:49.719443 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-34d574bf-4083-4e2d-a8e4-ce48898b2ec7 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d" status: 404 len: 111 microversion: 2.1 time: 0.033065 May 19 14:09:49.719443 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 573/1158] 10.222.0.52 () {58 vars in 1235 bytes} [Thu May 19 14:09:49 2022] GET /compute/v2.1/servers/bfea4879-afb7-4f52-99f6-c666d214000d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 14:09:51.025176 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: DEBUG nova.api.openstack.wsgi [None req-8a06453d-a3b1-4800-9e91-06752a78f2d8 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] Calling method '.version_select at 0x7f5de21eb3a0>' {{(pid=123751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 14:09:51.056147 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO nova.api.openstack.requestlog [None req-8a06453d-a3b1-4800-9e91-06752a78f2d8 tempest-TestVolumeBootPattern-1335792019 tempest-TestVolumeBootPattern-1335792019-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-37618688" status: 202 len: 0 microversion: 2.1 time: 0.034818 May 19 14:09:51.057145 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: [pid: 123751|app: 0|req: 586/1159] 10.222.0.52 () {58 vars in 1256 bytes} [Thu May 19 14:09:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-37618688 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 14:10:59.409318 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:10:59.410003 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Thu May 19 14:10:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:11:25.663879 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:11:25.664544 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Thu May 19 14:11:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:12:10.194901 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:12:10.195663 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Thu May 19 14:12:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:12:48.504491 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:12:48.504491 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Thu May 19 14:12:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:14:19.421829 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:14:19.423041 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Thu May 19 14:14:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:14:45.673023 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:14:45.673627 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Thu May 19 14:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:14:46.270192 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:14:46.270807 dv-cinder-784815-14-iscsi devstack@n-api.service[123751]: Thu May 19 14:14:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 14:14:48.538540 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 14:14:48.539141 dv-cinder-784815-14-iscsi devstack@n-api.service[123752]: Thu May 19 14:14:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!